-- Logs begin at Wed 2022-08-31 18:31:49 UTC, end at Wed 2022-08-31 19:39:23 UTC. -- Aug 31 19:08:43.361329 dv-cinder-852210-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 19:08:43.370924 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:08:43 2022] *** Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: nodename: dv-cinder-852210-6-iscsi Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: machine: x86_64 Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: clock source: unix Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: pcre jit disabled Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: detected number of CPU cores: 4 Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: current working directory: / Aug 31 19:08:43.372204 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: your processes number limit is 47680 Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: your memory page size is 4096 bytes Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: detected max file descriptor number: 2048 Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: lock engine: pthread robust mutexes Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: thunder lock: enabled Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 19:08:43.372970 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:08:43.412123 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: Python main interpreter initialized at 0x5646ca5c29c0 Aug 31 19:08:43.412123 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: python threads support enabled Aug 31 19:08:43.412123 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: your server socket listen backlog is limited to 100 connections Aug 31 19:08:43.412123 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:08:43.412510 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:08:43.412510 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: *** Operational MODE: preforking *** Aug 31 19:08:43.412750 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:08:43.412750 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: spawned uWSGI master process (pid: 105658) Aug 31 19:08:43.412959 dv-cinder-852210-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 19:08:43.417092 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: spawned uWSGI worker 1 (pid: 105659, cores: 1) Aug 31 19:08:43.417092 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: spawned uWSGI worker 2 (pid: 105660, cores: 1) Aug 31 19:08:43.417092 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:08:44.074980 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:08:44.094184 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:08:45.169753 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:08:45.169753 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: from cryptography.utils import int_from_bytes Aug 31 19:08:45.170666 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:08:45.170666 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: from cryptography.utils import int_from_bytes Aug 31 19:08:45.176636 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:08:45.176636 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: from cryptography.utils import int_from_bytes Aug 31 19:08:45.177182 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:08:45.177182 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: from cryptography.utils import int_from_bytes Aug 31 19:08:47.712151 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:08:47.712742 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:08:47.712947 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:08:47.713097 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:08:47.713722 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:08:47.713851 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:08:47.713956 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:08:47.714053 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:08:47.714136 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.714228 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.714317 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:08:47.714479 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:08:47.714606 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.714825 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.714930 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.715154 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.715253 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.715458 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.715558 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.715773 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.715868 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716092 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716220 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716405 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716493 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716681 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716770 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.716994 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.717097 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.717315 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-6-iscsi {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.717410 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.717622 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.717770 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.717923 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718036 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718228 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718322 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-6-iscsi {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718538 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718632 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718836 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.718936 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.719144 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.719237 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.719443 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.719536 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.719752 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.719937 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.720072 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.720377 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.720458 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.720733 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.720923 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.721092 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.721271 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.721447 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.721632 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.721839 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722020 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722208 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722388 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722511 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722635 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722741 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.722851 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.723084 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.723208 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.723419 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.723530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.723748 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.724019 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-6-iscsi {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.724141 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.724434 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-6-iscsi {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.724591 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.724773 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.725085 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.725247 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.725399 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.725561 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.725800 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726021 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726176 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726324 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726427 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726564 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726701 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.726853 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.727024 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.727147 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.727331 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.727532 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.727689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.727908 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728110 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728256 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728434 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728562 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728731 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728851 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.728961 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729125 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729229 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729311 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729475 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729620 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729787 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.729908 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730099 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730200 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730393 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730489 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730647 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730797 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.730951 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.731111 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.731266 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.731416 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.731585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.731700 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.731898 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.732005 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.732144 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.732229 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.732384 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.732502 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.732728 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.733049 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.733211 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.733362 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.733630 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.733745 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.733936 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.734189 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.734284 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.734533 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.734749 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.734945 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.735129 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.735274 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.735432 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.735749 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.735889 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.736060 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.736370 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.736458 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.736694 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.736973 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.737076 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.737394 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.737532 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.737645 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.737980 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.738186 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.738323 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.738625 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.738759 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.738926 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.739057 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.739243 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.739564 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.739657 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.739871 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.740176 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.740292 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.740480 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.740644 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.740826 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741023 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741144 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741284 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741450 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741615 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741725 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.741937 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.742027 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.742259 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.742377 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.742573 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.742702 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.742875 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743009 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743180 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743288 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743486 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743580 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743783 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.743876 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.744084 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.744179 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.744386 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.744470 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.744710 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.744817 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745016 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745112 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745269 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745355 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745573 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745673 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745875 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.745975 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.746187 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.746273 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.746486 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.746571 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.746788 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.746888 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747088 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747182 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747383 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747469 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747684 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747776 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.747982 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.748067 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.748280 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.748385 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.748617 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.748725 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.748907 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749001 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749207 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749293 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749507 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749593 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.749895 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.750104 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.750191 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.750417 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.750504 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.750726 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.750819 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751027 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751113 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751323 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751410 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751626 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751718 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.751936 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.752052 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.752248 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.752439 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.752557 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.752805 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.752897 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.753110 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.753211 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.753958 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754069 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754276 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754433 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754582 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754721 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754874 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.754963 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.755174 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.755271 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.755475 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.755564 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.755790 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.755878 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.756088 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.756182 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.756389 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.756477 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.756729 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.756871 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.757032 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.757142 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.757332 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.757421 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.757629 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.757716 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.757928 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.758014 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.758226 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.758362 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.758583 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.758705 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.758886 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.759043 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.759186 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.759376 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.759496 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.759697 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.759784 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.760011 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.760102 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.760328 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.760419 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.760689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.760782 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.760988 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.761077 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.761301 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:08:47.761405 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.761613 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.761706 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.761930 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762017 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762248 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762334 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762571 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762670 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762885 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.762970 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.763202 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.763296 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.763515 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.763609 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.763822 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.763910 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.764133 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.764493 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.764656 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.764780 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.764869 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.764950 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.765074 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.765163 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.765383 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.765488 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.765700 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.765790 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766011 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766150 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766381 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766540 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766674 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766764 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.766996 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.767107 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.767296 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.767381 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.767603 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.767688 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.767918 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768005 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768245 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768330 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768555 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768653 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768888 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.768963 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.770135 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.770300 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.770441 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.770441 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.770615 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.770736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771048 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771135 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771362 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771486 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771672 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771796 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.771994 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.772126 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.772305 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.772429 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.772636 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.772752 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.772955 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773044 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773270 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773362 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773583 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773679 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773894 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.773970 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.774202 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.774278 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.774512 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.774601 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.774818 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.774895 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.775122 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.775199 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.775427 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.775511 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.775733 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.775809 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.776039 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.776115 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.776362 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.776440 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.776690 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.776771 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777010 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777097 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777322 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777417 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777720 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.777940 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778033 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778246 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778552 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778638 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778858 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.778944 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.779161 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.779263 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.779463 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.779552 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.779765 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.779871 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.780070 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.780171 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.780371 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.780497 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.780705 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.780817 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781032 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781179 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781324 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781474 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781619 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781749 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.781930 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782052 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782233 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782324 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782543 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782704 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782843 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.782992 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.783131 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.783233 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.783421 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.783511 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.783726 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.783815 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.784025 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.784123 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.784343 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.784432 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.784724 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.784831 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.785055 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.785210 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.785379 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.785529 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.785705 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.785854 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786006 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786122 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786316 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786431 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786622 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786744 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.786929 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.787080 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.787236 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.787334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.787544 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.787633 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.787869 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788033 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788173 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788315 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788454 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788665 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788860 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.788998 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.789118 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.789230 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.789410 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.789511 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.789730 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.789892 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790032 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790170 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790338 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790482 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790702 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790855 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.790994 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791132 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791271 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791411 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791715 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791855 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.791996 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792144 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792286 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792437 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792608 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792728 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792843 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.792955 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.793144 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.793304 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.793444 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.793585 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.793762 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.793908 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.794064 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.794206 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.794372 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.794461 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.794685 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.794776 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.795249 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.795365 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.795569 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.795655 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.795874 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.795970 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.796187 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.796274 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.796513 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.796621 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.796850 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797168 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797168 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797342 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797461 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797562 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797773 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.797862 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.798079 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.798169 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.798385 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.798474 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.798692 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.798826 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799003 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799162 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799303 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799443 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799608 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799778 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.799977 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.800078 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.800227 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.800357 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.800642 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.800799 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.800959 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801101 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801275 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801372 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801575 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801679 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801886 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.801981 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.802195 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.802284 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.802522 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.802610 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.802830 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.802917 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.803148 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.803241 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.803452 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.803540 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.803761 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.803850 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804067 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804211 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804364 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804508 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804671 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804799 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.804982 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.805070 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.805296 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.805387 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.805604 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.805701 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.805914 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806005 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806217 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806306 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806531 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806618 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806834 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.806929 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.807142 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.807229 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.807442 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.807529 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.807752 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.807848 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.808060 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.808161 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.808365 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.808453 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.808707 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.808812 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809022 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809165 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809478 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809627 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809746 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.809927 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810016 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810232 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810320 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810535 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810630 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810835 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.810974 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.811141 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.811232 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.811458 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.811545 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.811762 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.811850 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.812070 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.812164 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.812370 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.812457 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.812697 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.812785 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813001 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813087 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813301 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813390 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813598 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813693 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.813910 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814070 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814213 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814352 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814501 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814742 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814872 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.814965 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.815120 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.815209 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.815418 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.815506 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.815717 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.815815 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.816652 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.816748 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.816884 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817034 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817230 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817336 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817457 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817546 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817756 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.817843 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818094 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818207 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818406 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818554 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818696 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818849 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.818999 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.819152 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.819285 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.819414 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.819592 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.819733 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.819882 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820005 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820187 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820305 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820496 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820673 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820835 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.820977 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.821128 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.821430 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.821545 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.821735 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.821890 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822032 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822157 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822328 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822437 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822636 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822764 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.822945 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.823031 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.823248 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.823334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.823559 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.823701 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.823936 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.824071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.824241 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.824381 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.824548 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.824770 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.824919 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.825078 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.825231 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.825437 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.825589 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.825742 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.825881 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.826051 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.826194 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.826334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.826473 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.826721 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.826874 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827015 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827140 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827362 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827588 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827744 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827897 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.827988 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828069 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828158 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828336 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828436 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828667 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828762 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.828972 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829059 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829273 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829373 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829581 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829669 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829881 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.829976 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.830181 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.830282 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.830481 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.830583 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.830787 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.830873 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.831085 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.831181 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.831390 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.831618 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.832315 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.832452 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.832667 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.832828 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.832982 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.833077 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.833291 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.833507 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.833606 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.833912 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.834100 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.834218 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.834410 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.834525 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.834735 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.834824 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835049 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835195 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835353 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835490 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835649 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835775 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.835950 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.836087 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.836287 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.836425 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.836640 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.836768 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.836949 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.837121 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.837250 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.837529 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.837671 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.837855 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.837981 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.838164 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.838289 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.838466 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.838589 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.838770 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.838902 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839083 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839209 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839381 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839507 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839681 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839807 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.839988 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.840123 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.840292 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.840420 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.840629 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.840760 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.840922 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841064 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841226 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841361 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841538 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841683 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841838 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.841981 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.842127 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.842262 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.842433 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.842558 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.842733 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.842878 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843046 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843173 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843351 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843475 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843650 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843771 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.843950 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.844076 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.844253 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.844379 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.844554 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.844741 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.844865 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845001 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845171 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845301 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845470 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845608 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845787 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.845921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.846097 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.846367 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.846505 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.846736 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.846871 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.847048 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.847389 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.847663 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.847841 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.847980 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.848122 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.848297 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.848630 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.848775 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.848944 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.849236 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.849373 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.849559 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.849694 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.849873 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.849999 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.850187 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.850313 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.850510 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.850674 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.850858 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.850984 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.851269 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.851394 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.851651 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.851847 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.851972 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.852168 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.852304 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.852500 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.852647 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.852856 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.852987 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.853170 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.853299 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.853481 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.853616 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.853786 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.853912 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854089 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854222 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854396 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854523 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854731 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854866 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.854991 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.855121 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.855277 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.855415 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.855581 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.855709 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.855884 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856010 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856202 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856341 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856506 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856670 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856837 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.856988 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.857141 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.857279 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.857442 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.857578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.857770 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.857962 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858087 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858234 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858362 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858486 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858672 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858798 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.858984 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.859127 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.859294 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.859419 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.859606 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.859744 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.859914 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860039 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860225 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860352 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860525 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860685 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860861 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.860987 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.861169 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.861295 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.861480 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.861607 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.861783 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.861963 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.862085 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.862215 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.862396 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.862533 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.862706 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.862967 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.863123 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.863343 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.863485 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.863828 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.863964 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.864144 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.864453 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.864600 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.864881 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865020 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865197 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865524 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865648 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865833 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.865971 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.866146 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.866271 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.866457 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.866581 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.866772 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.866912 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.867086 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.867211 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.867392 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.867522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.867702 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.867876 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.868009 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.868137 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.868405 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.868531 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.868745 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.868926 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.869054 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.869243 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.869370 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.869633 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.869770 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.869962 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.870274 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.870399 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.870581 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.870831 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.870971 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.871197 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.871358 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.871487 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.871812 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.871948 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.872233 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.872401 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.872530 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.872867 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.873016 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.873290 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.873505 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.873643 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.873901 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.874222 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.874359 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.874536 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.874741 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.874869 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.875155 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.875278 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.875473 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.875785 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.875910 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.876110 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.876317 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.876444 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.876758 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.876885 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.877076 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.877384 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.877509 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.877708 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.877940 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.878074 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.878334 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.879062 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.879267 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.879530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.879787 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.880110 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.880423 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.880547 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.880773 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.881042 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.881202 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.881402 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.881579 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.881706 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.882008 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.882187 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.882312 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.882606 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.882744 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.882933 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.883148 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.883283 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.883537 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.883673 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.883850 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.884159 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.884297 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.884465 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.884761 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.884906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.885105 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.885294 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.885420 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.885722 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.885863 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.886037 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.886354 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.886489 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.886679 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.886879 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.887011 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.887296 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.887425 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.887611 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.887915 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.888133 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.888280 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.888509 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.888772 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.888925 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.889177 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.889304 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.889501 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.889834 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.889958 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.890165 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.890461 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.890588 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.890800 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.890980 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.891134 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.891456 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.891581 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.891776 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.892032 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.892168 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.892395 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.892635 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.892810 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.893022 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.893158 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.893343 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.893621 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.893747 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.893928 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.894201 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.894857 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.895144 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.895379 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.895515 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.895736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.895914 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.896064 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.896371 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.896497 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.896738 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.896979 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.897129 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.897347 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.897473 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.897655 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.897958 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.898095 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.898305 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.898515 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.898658 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.898929 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.899055 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.899240 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.899505 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.899656 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.899873 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.900012 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.900192 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.900345 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.900495 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.900720 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.900858 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901127 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901279 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901431 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901571 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901708 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901849 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.901987 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.902200 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.902339 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.902466 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.902588 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.902727 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.902863 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903021 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903158 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903308 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903501 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903652 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903824 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.903976 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.904114 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.904252 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.904400 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.904549 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.904738 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.904880 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905020 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905157 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905325 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905465 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905644 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905771 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.905956 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.906078 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.906278 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.906398 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.906588 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.906707 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.906888 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907007 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907208 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907343 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907513 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907637 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907815 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.907945 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.908115 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.908248 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.908417 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.908536 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.908792 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.909013 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.909135 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.909453 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.909578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.909804 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.909931 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.910114 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.910260 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.910455 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.910599 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.910772 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.910936 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.911095 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.911377 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.911502 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.911707 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.911842 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912020 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912137 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912336 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912458 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912670 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912795 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.912978 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.913116 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.913282 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.913414 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.913592 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.913712 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.913918 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.914051 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.914254 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.914479 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.914600 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.914879 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.915025 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.915178 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.915496 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.915631 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.916037 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.916175 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.916353 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.916691 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.916850 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917031 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917176 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917356 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917605 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917740 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917855 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.917966 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.918075 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.918297 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.918435 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.918598 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.918718 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.918902 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.919022 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.919208 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.919339 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.919516 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.919644 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.919822 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.920220 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.920410 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.920543 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.920788 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.920900 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.921137 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.921257 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.921459 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.921771 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.921909 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.922299 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.922444 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.922623 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.922772 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.922947 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.923083 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.923265 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.923385 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.923585 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.923720 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.923902 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924018 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924209 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924340 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924524 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924696 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924863 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.924980 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.925177 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.925803 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.926042 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.926359 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.926503 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.926739 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.926934 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.927292 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.927439 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.927625 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.927757 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.927946 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.928084 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.928259 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.928554 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.928831 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.928963 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.929074 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.929216 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.929530 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.929662 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.929840 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.930107 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.930245 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.930432 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.930578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.930747 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.930882 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931061 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931193 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931368 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931514 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931688 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931776 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.931972 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.932062 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.932278 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.932377 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.932617 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.932710 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.932929 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.933029 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.933242 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.933332 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.933547 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.933635 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.933858 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934007 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934194 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934282 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934510 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934669 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934810 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.934956 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935130 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935270 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935393 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935512 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935825 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935999 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.935999 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.936238 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.936387 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.936541 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.936783 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.936944 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937082 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937222 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937362 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937505 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937640 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937825 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.937962 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.938162 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.938312 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.938479 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.938636 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.938780 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.938910 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.939087 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.939223 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.939402 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.939551 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.939721 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.939932 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.940068 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.940245 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.940369 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.940591 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.940687 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.941185 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.941852 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.941991 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.942137 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.942304 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.942453 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.942591 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.942730 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.942871 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943024 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943175 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943327 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943468 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943620 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943761 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.943914 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.944064 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.944217 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.944423 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.944617 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.944777 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.944926 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945077 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945217 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945358 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945508 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945676 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945832 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.945977 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.946195 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.946342 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.946485 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.946636 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.946781 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.946911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.947866 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.948168 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.948358 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.948545 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.948763 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.948939 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.949112 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.949285 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.949459 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.949643 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.949824 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.949956 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950090 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950224 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950435 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950546 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950709 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950829 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950939 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950939 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950939 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.950939 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.951479 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.951621 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.951761 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.951913 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.952061 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.952176 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.952312 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.952443 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.952853 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953030 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953180 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953318 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953318 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953570 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953702 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953842 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.953971 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.954097 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.954229 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.954359 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.954562 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.954723 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.954866 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955005 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955143 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955284 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955426 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955587 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955738 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.955877 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.956033 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.956232 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.956394 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.956523 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.959793 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.959946 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960088 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960088 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960349 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960475 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960475 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960727 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960869 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.960994 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961143 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961268 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961394 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961520 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961653 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961781 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.961918 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962042 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962299 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962446 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962571 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962711 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962845 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962971 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.962971 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963213 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963338 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963338 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963589 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963715 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963841 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.963841 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964078 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964220 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964220 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964454 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964720 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964846 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.964974 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965125 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965249 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965249 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965488 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965611 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965750 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.965874 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966010 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966133 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966258 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966383 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966517 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966651 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966774 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.966916 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967050 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967183 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967319 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967454 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967587 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967711 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967837 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.967975 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968108 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968231 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968365 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968494 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968652 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968789 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.968913 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969039 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969165 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969290 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969418 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969556 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969821 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.969955 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970078 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970217 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970359 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970482 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970607 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970733 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.970870 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971011 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971135 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971261 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971386 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971513 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971638 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971778 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.971901 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.972039 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.972457 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.972609 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.972734 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.972875 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973000 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973126 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973252 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973399 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973665 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973793 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.973929 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974063 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974188 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974326 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974459 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974582 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974720 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974846 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.974973 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975111 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975235 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975366 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975490 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975617 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975778 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.975921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.976046 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.976181 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.976389 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.976623 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.976775 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.976899 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977026 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977159 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977317 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977443 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977632 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977756 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.977962 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978089 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978265 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978402 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978566 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978703 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978866 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.978992 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.979171 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.979385 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.979509 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.979637 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.979774 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.979910 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.980050 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.980185 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.980310 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.980480 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.980641 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.980768 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:08:47.980941 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.981236 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.981535 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.981839 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.982140 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.982439 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.982742 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.983038 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.983332 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.983627 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.983932 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.984230 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.984557 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.984975 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.985288 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.985605 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.985913 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.986230 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.986535 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.986850 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.987165 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.987476 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.988294 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.988698 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.988987 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.989300 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.989600 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.989906 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.990212 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.990517 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.990840 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.991161 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.991463 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.991784 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.992102 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.992421 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.992759 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.993062 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.993389 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.993696 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.994002 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.994312 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.994619 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.994922 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.995232 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.995539 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.995843 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.996151 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.996460 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.996812 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.997131 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.997429 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.997756 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.998078 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.998419 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.998727 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.999065 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.999389 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:47.999698 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:48.000088 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:48.000349 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:08:48.000614 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:08:48.140551 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Registered counter for database nova_api Aug 31 19:08:48.162970 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO dbcounter [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Registered counter for database nova_api Aug 31 19:08:48.169480 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.176779 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.184089 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_db.sqlalchemy.engines [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.196190 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writer thread running {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.234082 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.context [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95c90422-9fe5-49ea-9d04-23948be25350(cell1) {{(pid=105660) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:08:48.238060 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:08:48.238526 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:08:48.240095 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:08:48.240851 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:08:48.241303 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:08:48.243324 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:08:48.245413 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Registered counter for database nova_cell0 Aug 31 19:08:48.251203 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Registered counter for database nova_cell1 Aug 31 19:08:48.256783 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.context [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95c90422-9fe5-49ea-9d04-23948be25350(cell1) {{(pid=105659) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:08:48.258858 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.260790 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_concurrency.lockutils [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:08:48.261266 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_concurrency.lockutils [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:08:48.262866 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_concurrency.lockutils [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:08:48.263604 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_concurrency.lockutils [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:08:48.263860 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.264047 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_concurrency.lockutils [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:08:48.264507 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.266102 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_concurrency.lockutils [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:08:48.268147 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO dbcounter [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Registered counter for database nova_cell0 Aug 31 19:08:48.273426 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO dbcounter [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Registered counter for database nova_cell1 Aug 31 19:08:48.280918 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_db.sqlalchemy.engines [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.286614 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writer thread running {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.287267 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_db.sqlalchemy.engines [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.408036 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.417989 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO dbcounter [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Registered counter for database nova_cell0 Aug 31 19:08:48.428260 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_db.sqlalchemy.engines [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.430774 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writer thread running {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.433280 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writer thread running {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.439852 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO dbcounter [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Registered counter for database nova_cell0 Aug 31 19:08:48.447866 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG oslo_db.sqlalchemy.engines [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:08:48.453432 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writer thread running {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:08:48.779148 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: WARNING keystonemiddleware.auth_token [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:08:48.784425 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:08:48.787421 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: WARNING keystonemiddleware.auth_token [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:08:48.792439 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:08:49.136632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: WARNING keystonemiddleware.auth_token [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:08:49.140348 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:08:49.142669 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: WARNING keystonemiddleware.auth_token [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:08:49.146152 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: WARNING keystonemiddleware.auth_token [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:08:49.148426 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646ca5c29c0 pid: 105659 (default app) Aug 31 19:08:49.150544 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:08:49.151424 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646ca5c29c0 pid: 105660 (default app) Aug 31 19:08:49.151742 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-6a368392-17d9-48fa-a2d2-cc7e5a618f47 None None] 10.222.0.95 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Aug 31 19:08:49.152149 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 1/1] 10.222.0.95 () {50 vars in 788 bytes} [Wed Aug 31 19:08:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:09.513188 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:09.514417 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Aug 31 19:10:09.514982 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 1/2] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:09.528831 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_api:SELECT=3 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:09.529873 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_cell0:SELECT=3 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:09.530703 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_cell1:SELECT=3 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:09.531525 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_cell0:SELECT=3 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:10.401050 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-c794b578-f292-4a00-9ca0-f1b06e998f73 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:10.433763 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-c794b578-f292-4a00-9ca0-f1b06e998f73 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910475 Aug 31 19:10:10.436617 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 2/3] 10.222.0.95 () {60 vars in 1292 bytes} [Wed Aug 31 19:10:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:12.826791 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:12.827934 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-f18cc361-7ebc-4b29-8427-891004e15f1e None None] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Aug 31 19:10:12.828530 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 2/4] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:13.327179 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-4d94767b-84f9-4e23-bc9b-1c1a42194c4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "c1", "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:13.381098 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-4d94767b-84f9-4e23-bc9b-1c1a42194c4f admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.544862 Aug 31 19:10:13.382179 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 3/5] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:13.603481 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-09259a4d-93b2-4a7c-9db8-c1c38eaa1586 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:13.622243 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=3 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:13.623056 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=3 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:13.623745 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell1:SELECT=3 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:13.624438 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:13.679093 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-09259a4d-93b2-4a7c-9db8-c1c38eaa1586 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288406 Aug 31 19:10:13.680038 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 3/6] 10.222.0.95 () {64 vars in 1336 bytes} [Wed Aug 31 19:10:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:16.089695 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-4d94767b-84f9-4e23-bc9b-1c1a42194c4f admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:16.090711 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-4d94767b-84f9-4e23-bc9b-1c1a42194c4f admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 19:10:16.091108 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 4/7] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:16.769827 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-02c784a4-eedc-4801-a9e6-73d8d5f3c9e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:16.808059 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-02c784a4-eedc-4801-a9e6-73d8d5f3c9e2 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710043 Aug 31 19:10:16.808617 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 4/8] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:16.821667 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-d2db2823-67fb-4358-872c-025005911bc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:16.859309 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-d2db2823-67fb-4358-872c-025005911bc0 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041283 Aug 31 19:10:16.872966 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 5/9] 10.222.0.95 () {64 vars in 1336 bytes} [Wed Aug 31 19:10:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:19.469790 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-02c784a4-eedc-4801-a9e6-73d8d5f3c9e2 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:19.472404 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-02c784a4-eedc-4801-a9e6-73d8d5f3c9e2 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005157 Aug 31 19:10:19.472885 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 5/10] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:19.870830 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7d232c5e-44ae-4a4b-9b3f-5067f97752ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "swap": 0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:19.889888 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-7d232c5e-44ae-4a4b-9b3f-5067f97752ef admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410258 Aug 31 19:10:19.890434 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 6/11] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:19.902512 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-a1609b38-17f0-486c-a1c5-b461219d95e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:19.927993 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-a1609b38-17f0-486c-a1c5-b461219d95e3 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029134 Aug 31 19:10:19.928558 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 6/12] 10.222.0.95 () {64 vars in 1336 bytes} [Wed Aug 31 19:10:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:22.340067 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7d232c5e-44ae-4a4b-9b3f-5067f97752ef admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:22.341681 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-7d232c5e-44ae-4a4b-9b3f-5067f97752ef admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Aug 31 19:10:22.342099 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 7/13] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:22.843030 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-069df63a-8caa-45fe-926e-426a436bcb94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "vcpus": 2}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:22.864235 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-069df63a-8caa-45fe-926e-426a436bcb94 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513620 Aug 31 19:10:22.865520 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 7/14] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:22.878076 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-6043d858-cecc-425a-862f-f06b6031d1c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:22.904798 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-6043d858-cecc-425a-862f-f06b6031d1c7 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031005 Aug 31 19:10:22.906736 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 8/15] 10.222.0.95 () {64 vars in 1336 bytes} [Wed Aug 31 19:10:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:25.331933 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-069df63a-8caa-45fe-926e-426a436bcb94 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:25.332884 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-069df63a-8caa-45fe-926e-426a436bcb94 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 31 19:10:25.334800 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 8/16] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:25.782622 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-39ecb61e-bd24-4693-83a2-88eb2ccc551d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:25.804062 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-39ecb61e-bd24-4693-83a2-88eb2ccc551d admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464654 Aug 31 19:10:25.804621 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 9/17] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:25.817285 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-22c3795d-5960-4f7c-a7f1-8ab49b14cb18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:25.843980 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-22c3795d-5960-4f7c-a7f1-8ab49b14cb18 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031063 Aug 31 19:10:25.849213 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 9/18] 10.222.0.95 () {64 vars in 1336 bytes} [Wed Aug 31 19:10:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:28.261685 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-39ecb61e-bd24-4693-83a2-88eb2ccc551d admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:28.262946 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-39ecb61e-bd24-4693-83a2-88eb2ccc551d admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Aug 31 19:10:28.263406 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 10/19] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:28.712382 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-3b201390-1b4e-4a79-820c-1fd3b1e66718 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:28.737732 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-3b201390-1b4e-4a79-820c-1fd3b1e66718 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466263 Aug 31 19:10:28.738565 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 10/20] 10.222.0.95 () {60 vars in 1292 bytes} [Wed Aug 31 19:10:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:10:31.510550 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-39ecb61e-bd24-4693-83a2-88eb2ccc551d admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:31.512028 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-39ecb61e-bd24-4693-83a2-88eb2ccc551d admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 31 19:10:31.512725 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 11/21] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:10:31.949780 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-575c52a7-ffaf-485c-8411-106a17f53071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:31.969920 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-575c52a7-ffaf-485c-8411-106a17f53071 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.449926 Aug 31 19:10:31.970578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 11/22] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:31.983444 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-cf5556cd-4182-4936-8dac-88095ce611e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:32.010309 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-cf5556cd-4182-4936-8dac-88095ce611e3 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030715 Aug 31 19:10:32.010913 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 12/23] 10.222.0.95 () {64 vars in 1333 bytes} [Wed Aug 31 19:10:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:34.370306 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-575c52a7-ffaf-485c-8411-106a17f53071 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:34.371233 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-575c52a7-ffaf-485c-8411-106a17f53071 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 31 19:10:34.371632 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 12/24] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:34.746033 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7bc425ce-acdb-4e6c-96c2-85ec6e3ce1b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:34.765932 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-7bc425ce-acdb-4e6c-96c2-85ec6e3ce1b4 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.388192 Aug 31 19:10:34.768638 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 13/25] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:34.778440 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-a7f3d0bf-2b03-446f-98fa-8a8eb0c27dd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:34.803338 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-a7f3d0bf-2b03-446f-98fa-8a8eb0c27dd2 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028547 Aug 31 19:10:34.803886 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 13/26] 10.222.0.95 () {64 vars in 1333 bytes} [Wed Aug 31 19:10:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:37.386209 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7bc425ce-acdb-4e6c-96c2-85ec6e3ce1b4 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:37.387130 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-7bc425ce-acdb-4e6c-96c2-85ec6e3ce1b4 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 31 19:10:37.387533 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 14/27] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:37.901890 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-6c4bb7dc-85a2-4ffa-8ec2-a7b8bb720d37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:37.926777 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-6c4bb7dc-85a2-4ffa-8ec2-a7b8bb720d37 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.531887 Aug 31 19:10:37.927766 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 14/28] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:37.940221 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-81befcd9-64d5-452f-a313-ac3a8d265b6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:37.966727 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-81befcd9-64d5-452f-a313-ac3a8d265b6e admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030250 Aug 31 19:10:37.967305 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 15/29] 10.222.0.95 () {64 vars in 1333 bytes} [Wed Aug 31 19:10:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:40.386882 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-6c4bb7dc-85a2-4ffa-8ec2-a7b8bb720d37 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:40.387798 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-6c4bb7dc-85a2-4ffa-8ec2-a7b8bb720d37 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 31 19:10:40.388188 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 15/30] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:40.863620 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-cd504cae-8f06-4213-9b18-3bc8fae0077e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "name": "m1.large"}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:40.869961 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:10:40.885983 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-cd504cae-8f06-4213-9b18-3bc8fae0077e admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491574 Aug 31 19:10:40.886532 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 16/31] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:40.899430 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-eed27071-3e8d-4dc9-9d58-26dadb53990d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:40.932867 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-eed27071-3e8d-4dc9-9d58-26dadb53990d admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037109 Aug 31 19:10:40.934085 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 16/32] 10.222.0.95 () {64 vars in 1333 bytes} [Wed Aug 31 19:10:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:10:43.454642 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-cd504cae-8f06-4213-9b18-3bc8fae0077e admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:10:43.455664 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-cd504cae-8f06-4213-9b18-3bc8fae0077e admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Aug 31 19:10:43.456225 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 17/33] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:10:43.936751 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-6f5f260f-054d-40ef-96a9-b25313c1d1ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "disk": 160}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:43.960875 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-6f5f260f-054d-40ef-96a9-b25313c1d1ec admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.498328 Aug 31 19:10:43.964647 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 17/34] 10.222.0.95 () {64 vars in 1283 bytes} [Wed Aug 31 19:10:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:10:43.973748 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-29593621-c6b7-46e1-a704-b524314cfbaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:10:43.999993 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-29593621-c6b7-46e1-a704-b524314cfbaf admin admin] 10.222.0.95 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029900 Aug 31 19:10:44.008940 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 18/35] 10.222.0.95 () {64 vars in 1333 bytes} [Wed Aug 31 19:10:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:11:02.069352 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-6f5f260f-054d-40ef-96a9-b25313c1d1ec admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:02.070367 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-6f5f260f-054d-40ef-96a9-b25313c1d1ec admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 31 19:11:02.070790 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 18/36] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:02.082140 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:02.465862 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-011a1a00-a2a0-483f-964d-9295bf83db1a admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:02.485008 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-011a1a00-a2a0-483f-964d-9295bf83db1a admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407909 Aug 31 19:11:02.485509 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 19/37] 10.222.0.95 () {60 vars in 1292 bytes} [Wed Aug 31 19:11:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:03.552480 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-6f5f260f-054d-40ef-96a9-b25313c1d1ec admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:03.553512 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-6f5f260f-054d-40ef-96a9-b25313c1d1ec admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 31 19:11:03.553906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 19/38] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:11:04.084005 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7ca7ab22-9597-4794-ae8e-25ababde30ea admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:04.089557 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.wsgi [None req-7ca7ab22-9597-4794-ae8e-25ababde30ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7ca7ab22-9597-4794-ae8e-25ababde30ea admin admin] Request method failure captured: Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Accept: application/json Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Accept-Encoding: gzip, deflate Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Connection: keep-alive Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Content-Length: 0 Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Host: 10.222.0.95 Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Openstack-Api-Version: compute 2.90 Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Openstack-System-Scope: None Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: User-Agent: python-novaclient Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Auth-Token: gAAAAABjD7JHAfA_1AHaeE-oLhpx2q42jeAcipSkHE6fcob3vg5hh7KGNdpfffGRSFfQNxfLAk-FT3-_fDCjGWHMh0YJQnpRb0HSXrQ3oiu_mpT8iDnIP80IH1F_B9Rcg94dIykKyC_lwey2ZA78enHw6s3oUz9Fz76owaaCauwyfkvUDbP960s Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Domain-Id: None Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Domain-Name: None Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Identity-Status: Confirmed Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Is-Admin-Project: True Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Domain-Id: default Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Domain-Name: Default Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Name: admin Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Role: member,reader,admin Aug 31 19:11:04.092807 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Roles: member,reader,admin Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant: admin Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant-Name: admin Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User: admin Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Domain-Id: default Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Domain-Name: Default Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Id: 60fc2717779e40a0a55137c62461f753 Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Name: admin Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: method: > Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: exception: Flavor 42 could not be found. Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: action_args: {'id': '42'} Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:11:04.095632 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:04.097240 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.099335 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7ca7ab22-9597-4794-ae8e-25ababde30ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:11:04.101707 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-7ca7ab22-9597-4794-ae8e-25ababde30ea admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398711 Aug 31 19:11:04.101707 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 20/39] 10.222.0.95 () {60 vars in 1190 bytes} [Wed Aug 31 19:11:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 19:11:04.105774 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-cd8d424a-1ad6-4869-8a45-cb4dcc4f071c admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:04.110609 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:11:04.130991 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-cd8d424a-1ad6-4869-8a45-cb4dcc4f071c admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029394 Aug 31 19:11:04.131548 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 20/40] 10.222.0.95 () {60 vars in 1210 bytes} [Wed Aug 31 19:11:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:04.141710 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-6f515286-487a-49f8-945b-6badd0b8394d admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:04.165362 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-6f515286-487a-49f8-945b-6badd0b8394d admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027305 Aug 31 19:11:04.165892 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 21/41] 10.222.0.95 () {60 vars in 1210 bytes} [Wed Aug 31 19:11:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:04.176650 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-1e825612-3e55-4270-85c7-570b8014b4a1 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:04.182617 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.wsgi [None req-1e825612-3e55-4270-85c7-570b8014b4a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-1e825612-3e55-4270-85c7-570b8014b4a1 admin admin] Request method failure captured: Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Accept: application/json Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Accept-Encoding: gzip, deflate Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Connection: keep-alive Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Content-Length: 0 Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Host: 10.222.0.95 Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Openstack-Api-Version: compute 2.90 Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Openstack-System-Scope: None Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: User-Agent: python-novaclient Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Auth-Token: gAAAAABjD7JHAfA_1AHaeE-oLhpx2q42jeAcipSkHE6fcob3vg5hh7KGNdpfffGRSFfQNxfLAk-FT3-_fDCjGWHMh0YJQnpRb0HSXrQ3oiu_mpT8iDnIP80IH1F_B9Rcg94dIykKyC_lwey2ZA78enHw6s3oUz9Fz76owaaCauwyfkvUDbP960s Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Domain-Id: None Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Domain-Name: None Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Identity-Status: Confirmed Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Is-Admin-Project: True Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Id: default Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Name: Default Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Name: admin Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Role: member,reader,admin Aug 31 19:11:04.185906 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Roles: member,reader,admin Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant: admin Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant-Name: admin Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User: admin Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Id: default Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Name: Default Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Id: 60fc2717779e40a0a55137c62461f753 Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Name: admin Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: method: > Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: exception: Flavor 42 could not be found. Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: action_args: {'id': '42'} Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:11:04.187578 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:04.188908 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:04.190916 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-1e825612-3e55-4270-85c7-570b8014b4a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:11:04.192821 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-1e825612-3e55-4270-85c7-570b8014b4a1 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015227 Aug 31 19:11:04.192821 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 21/42] 10.222.0.95 () {60 vars in 1190 bytes} [Wed Aug 31 19:11:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:05.154922 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-6f515286-487a-49f8-945b-6badd0b8394d admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:05.155916 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-6f515286-487a-49f8-945b-6badd0b8394d admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 31 19:11:05.156356 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 22/43] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:05.683658 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-672aacac-6972-44bb-8320-923aa4397e89 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:05.689723 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.wsgi [None req-672aacac-6972-44bb-8320-923aa4397e89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-672aacac-6972-44bb-8320-923aa4397e89 admin admin] Request method failure captured: Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Accept: application/json Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Accept-Encoding: gzip, deflate Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Connection: keep-alive Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Content-Length: 0 Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Host: 10.222.0.95 Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Openstack-Api-Version: compute 2.90 Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Openstack-System-Scope: None Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: User-Agent: python-novaclient Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Auth-Token: gAAAAABjD7JJovlEqOQfwQYMXvzm0ZTLMmxCviMttYMpQtCICtHhG_v_ivrvoiFftYymo9S6CkzvnE4GpfpUgMGdFhsUFJkw2mtRsWJwJjds2SZfoElIgRN-Ku5OItN_cTEWPIodzsi2uf2HU8U34lBfpWPFuJAO3LvgcEEOKrTEh3O8nJZCm2M Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Domain-Id: None Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Domain-Name: None Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Identity-Status: Confirmed Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Is-Admin-Project: True Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Id: default Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Name: Default Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Name: admin Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Role: member,reader,admin Aug 31 19:11:05.691230 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Roles: member,reader,admin Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant: admin Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant-Name: admin Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User: admin Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Id: default Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Name: Default Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Id: 60fc2717779e40a0a55137c62461f753 Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Name: admin Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: method: > Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: exception: Flavor 84 could not be found. Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: action_args: {'id': '84'} Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:11:05.692806 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:05.693689 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.694736 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-672aacac-6972-44bb-8320-923aa4397e89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:11:05.695772 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-672aacac-6972-44bb-8320-923aa4397e89 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394550 Aug 31 19:11:05.695772 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 22/44] 10.222.0.95 () {60 vars in 1190 bytes} [Wed Aug 31 19:11:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:05.702394 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-c039dac6-bb8e-45df-9efa-2984db63595b admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:05.719172 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-c039dac6-bb8e-45df-9efa-2984db63595b admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019880 Aug 31 19:11:05.719706 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 23/45] 10.222.0.95 () {60 vars in 1210 bytes} [Wed Aug 31 19:11:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:05.729287 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-06d2a5d2-7d07-44ac-a29b-53f0f272e806 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:05.747159 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-06d2a5d2-7d07-44ac-a29b-53f0f272e806 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021399 Aug 31 19:11:05.747708 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 23/46] 10.222.0.95 () {60 vars in 1210 bytes} [Wed Aug 31 19:11:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:11:05.759237 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-d32a6d2c-5972-4384-8829-d94f279916b0 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:05.764648 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.wsgi [None req-d32a6d2c-5972-4384-8829-d94f279916b0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-d32a6d2c-5972-4384-8829-d94f279916b0 admin admin] Request method failure captured: Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Accept: application/json Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Accept-Encoding: gzip, deflate Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Connection: keep-alive Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Content-Length: 0 Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Host: 10.222.0.95 Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Openstack-Api-Version: compute 2.90 Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Openstack-System-Scope: None Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: User-Agent: python-novaclient Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Auth-Token: gAAAAABjD7JJovlEqOQfwQYMXvzm0ZTLMmxCviMttYMpQtCICtHhG_v_ivrvoiFftYymo9S6CkzvnE4GpfpUgMGdFhsUFJkw2mtRsWJwJjds2SZfoElIgRN-Ku5OItN_cTEWPIodzsi2uf2HU8U34lBfpWPFuJAO3LvgcEEOKrTEh3O8nJZCm2M Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Domain-Id: None Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Domain-Name: None Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Identity-Status: Confirmed Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Is-Admin-Project: True Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Domain-Id: default Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Domain-Name: Default Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Name: admin Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Role: member,reader,admin Aug 31 19:11:05.767155 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Roles: member,reader,admin Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant: admin Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant-Name: admin Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User: admin Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Domain-Id: default Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Domain-Name: Default Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Id: 60fc2717779e40a0a55137c62461f753 Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Name: admin Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: method: > Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: exception: Flavor 84 could not be found. Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: action_args: {'id': '84'} Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:11:05.768522 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:05.769433 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:05.770536 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-d32a6d2c-5972-4384-8829-d94f279916b0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:11:05.771594 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-d32a6d2c-5972-4384-8829-d94f279916b0 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012888 Aug 31 19:11:05.771594 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 24/47] 10.222.0.95 () {60 vars in 1190 bytes} [Wed Aug 31 19:11:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:06.741040 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-06d2a5d2-7d07-44ac-a29b-53f0f272e806 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:06.742032 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-06d2a5d2-7d07-44ac-a29b-53f0f272e806 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 31 19:11:06.742414 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 24/48] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:07.271037 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7aa37b8d-fde5-4ddc-9897-606682604e6d admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:07.276769 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.wsgi [None req-7aa37b8d-fde5-4ddc-9897-606682604e6d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7aa37b8d-fde5-4ddc-9897-606682604e6d admin admin] Request method failure captured: Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Accept: application/json Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Accept-Encoding: gzip, deflate Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Connection: keep-alive Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Content-Length: 0 Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Host: 10.222.0.95 Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Openstack-Api-Version: compute 2.90 Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Openstack-System-Scope: None Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: User-Agent: python-novaclient Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Auth-Token: gAAAAABjD7JKg2Cbbb6cy5RY8FTYCLzKDPVAlTOskUP-exx-cb03JRRgHDlG8HK2LnBxO7cdaFaYQbphMZkK4O5Kj9L4GA4qV-ftUBrQqNvuqCwnzQKg2RZKD4TCA0gj9bkaMRL5TuTGu-09hiM4emdZqGnrxg3II2-Xx0NY0QVybWiqfBCS0RM Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Domain-Id: None Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Domain-Name: None Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Identity-Status: Confirmed Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Is-Admin-Project: True Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Domain-Id: default Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Domain-Name: Default Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Project-Name: admin Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Role: member,reader,admin Aug 31 19:11:07.278565 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Roles: member,reader,admin Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant: admin Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-Tenant-Name: admin Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User: admin Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Domain-Id: default Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Domain-Name: Default Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Id: 60fc2717779e40a0a55137c62461f753 Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: X-User-Name: admin Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: method: > Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: exception: Flavor 451 could not be found. Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: action_args: {'id': '451'} Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:11:07.280071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:07.280921 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.282530 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-7aa37b8d-fde5-4ddc-9897-606682604e6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:11:07.283617 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-7aa37b8d-fde5-4ddc-9897-606682604e6d admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397640 Aug 31 19:11:07.283617 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 25/49] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:11:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:11:07.290105 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-22b80ae4-1ba8-4d5c-9ec5-09a0fa05a3c6 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:07.305532 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-22b80ae4-1ba8-4d5c-9ec5-09a0fa05a3c6 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018973 Aug 31 19:11:07.306049 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 25/50] 10.222.0.95 () {60 vars in 1210 bytes} [Wed Aug 31 19:11:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:07.316166 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:07.331080 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018960 Aug 31 19:11:07.331600 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 26/51] 10.222.0.95 () {60 vars in 1210 bytes} [Wed Aug 31 19:11:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:11:07.340955 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-e6a91b1c-06e3-4bde-830f-ffbc9b31c55c admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:07.347352 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.wsgi [None req-e6a91b1c-06e3-4bde-830f-ffbc9b31c55c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-e6a91b1c-06e3-4bde-830f-ffbc9b31c55c admin admin] Request method failure captured: Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Accept: application/json Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Accept-Encoding: gzip, deflate Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Connection: keep-alive Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Content-Length: 0 Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Host: 10.222.0.95 Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Openstack-Api-Version: compute 2.90 Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Openstack-System-Scope: None Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: User-Agent: python-novaclient Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Auth-Token: gAAAAABjD7JKg2Cbbb6cy5RY8FTYCLzKDPVAlTOskUP-exx-cb03JRRgHDlG8HK2LnBxO7cdaFaYQbphMZkK4O5Kj9L4GA4qV-ftUBrQqNvuqCwnzQKg2RZKD4TCA0gj9bkaMRL5TuTGu-09hiM4emdZqGnrxg3II2-Xx0NY0QVybWiqfBCS0RM Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Domain-Id: None Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Domain-Name: None Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Identity-Status: Confirmed Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Is-Admin-Project: True Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Id: default Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Domain-Name: Default Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Project-Name: admin Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Role: member,reader,admin Aug 31 19:11:07.348947 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Roles: member,reader,admin Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4b2aa0a8faf9471ebd699445da59c0dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant: admin Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant-Id: 4b2aa0a8faf9471ebd699445da59c0dc Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-Tenant-Name: admin Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User: admin Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Id: default Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Domain-Name: Default Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Id: 60fc2717779e40a0a55137c62461f753 Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: X-User-Name: admin Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: method: > Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: exception: Flavor 451 could not be found. Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: action_args: {'id': '451'} Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:11:07.350585 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:07.351594 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: ERROR nova.api.openstack.wsgi Aug 31 19:11:07.352911 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-e6a91b1c-06e3-4bde-830f-ffbc9b31c55c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:11:07.354126 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-e6a91b1c-06e3-4bde-830f-ffbc9b31c55c admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012889 Aug 31 19:11:07.354126 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 26/52] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:11:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 19:11:08.321441 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:08.322444 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 31 19:11:08.322842 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 27/53] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:08.859054 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-028b4a3b-05d1-4cc8-b5cb-1dd8201bc495 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:11:08.879338 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-028b4a3b-05d1-4cc8-b5cb-1dd8201bc495 admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414166 Aug 31 19:11:08.879886 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 27/54] 10.222.0.95 () {64 vars in 1235 bytes} [Wed Aug 31 19:11:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:11:09.889698 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:09.891568 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Aug 31 19:11:09.892116 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 28/55] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:10.419927 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-2704a576-4d92-487f-9188-9d43e7ec297b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:11:10.440964 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-2704a576-4d92-487f-9188-9d43e7ec297b admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408825 Aug 31 19:11:10.441515 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 28/56] 10.222.0.95 () {64 vars in 1235 bytes} [Wed Aug 31 19:11:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:11:11.443287 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:11.444292 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 31 19:11:11.444732 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 29/57] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:11.981910 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-5868db64-e585-4362-94ed-c2701022c16c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:11:12.001377 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-5868db64-e585-4362-94ed-c2701022c16c admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412830 Aug 31 19:11:12.001926 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 29/58] 10.222.0.95 () {64 vars in 1235 bytes} [Wed Aug 31 19:11:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:11:12.982812 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:12.983839 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 31 19:11:12.984348 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 30/59] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:13.538275 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-44d8cf13-ff0c-4f95-a2e6-d1117f4df50a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:11:13.557837 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-44d8cf13-ff0c-4f95-a2e6-d1117f4df50a admin admin] 10.222.0.95 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.436128 Aug 31 19:11:13.558386 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 30/60] 10.222.0.95 () {64 vars in 1235 bytes} [Wed Aug 31 19:11:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:11:14.531108 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:14.532333 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 31 19:11:14.532767 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 31/61] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:11:15.058413 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-5f73ff75-35ca-485e-bb8a-82fb4831b1bc admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:11:15.079598 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-5f73ff75-35ca-485e-bb8a-82fb4831b1bc admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407687 Aug 31 19:11:15.080137 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 31/62] 10.222.0.95 () {60 vars in 1202 bytes} [Wed Aug 31 19:11:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:12:09.103273 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.104307 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-2f8b5655-0533-40ce-bd26-b7d5811f97d8 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 31 19:12:09.104743 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 32/63] 10.222.0.95 () {54 vars in 931 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:12:09.115478 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:09.531506 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-82c1f27d-37a4-4c7b-bf88-5340dce4277c admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.552469 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-82c1f27d-37a4-4c7b-bf88-5340dce4277c admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441464 Aug 31 19:12:09.553131 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 32/64] 10.222.0.95 () {60 vars in 1292 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:12:09.574832 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG dbcounter [-] [105659] Writing DB stats nova_api:SELECT=14 {{(pid=105659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:12:09.578589 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-635306a3-7f0e-4cf5-b5b2-1bdf38d1b13f admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.587027 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-635306a3-7f0e-4cf5-b5b2-1bdf38d1b13f admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013715 Aug 31 19:12:09.587545 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 33/65] 10.222.0.95 () {60 vars in 1283 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:09.599624 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-5b229ac8-34a3-49fd-985b-c6cdbd364296 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.607295 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-5b229ac8-34a3-49fd-985b-c6cdbd364296 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011285 Aug 31 19:12:09.607805 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 33/66] 10.222.0.95 () {60 vars in 1286 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:12:09.620380 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.629139 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012243 Aug 31 19:12:09.629602 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 34/67] 10.222.0.95 () {60 vars in 1286 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:12:09.642351 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-2c336467-6b37-4730-a73c-e1869386a192 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:12:09.649969 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-2c336467-6b37-4730-a73c-e1869386a192 admin admin] 10.222.0.95 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012413 Aug 31 19:12:09.650493 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 34/68] 10.222.0.95 () {60 vars in 1283 bytes} [Wed Aug 31 19:12:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:15:16.246984 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:16.248020 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 31 19:15:16.248411 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 35/69] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:16.396302 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=6 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:16.568662 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:16.572217 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.572784 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.573213 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.573922 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:16.574368 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:16.574783 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:16.610428 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-133879f5-ddc2-47cb-96a5-e24e5fe77b1d admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.215592 Aug 31 19:15:16.610999 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 35/70] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:15:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:15:17.480683 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:17.481681 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 31 19:15:17.482071 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 36/71] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:15:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:17.681171 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:17.684561 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:17.684999 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:17.685422 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:17.686127 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:17.686569 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:17.686979 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:17.707642 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-2a4d1dd9-6820-4350-82c4-29513edbf65a admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080108 Aug 31 19:15:17.708151 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 36/72] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:15:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:15:28.962796 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:28.963793 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 31 19:15:28.964186 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 37/73] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:29.115486 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:29.116380 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell1:SELECT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:29.117116 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=8 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:29.171835 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:29.175821 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.176289 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.176749 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.177463 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:29.177907 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:29.178324 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:29.198882 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-91a6376b-4d06-432f-b588-f8c7512ad4ad admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090685 Aug 31 19:15:29.199459 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 37/74] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:15:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:15:30.044684 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:30.045708 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 31 19:15:30.046098 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 38/75] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:15:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:30.250102 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:30.253718 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.254191 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.254639 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:30.255345 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:30.255787 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:30.256204 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:30.276312 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-ac98831c-fd8c-42c9-80fc-69fc983dc063 admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083686 Aug 31 19:15:30.276914 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 38/76] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:15:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:15:41.544123 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:41.545145 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 31 19:15:41.545534 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 39/77] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:41.695315 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell0:SELECT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:41.696005 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_cell1:SELECT=4 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:41.696629 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG dbcounter [-] [105660] Writing DB stats nova_api:SELECT=8 {{(pid=105660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:15:41.744780 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:41.748048 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.748516 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.748958 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.749681 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:41.750116 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:41.750576 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:41.776562 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-49cbf23e-c4e8-4889-9516-542b815d5de7 admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086438 Aug 31 19:15:41.777207 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 39/78] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:15:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:15:42.611227 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: DEBUG nova.api.openstack.wsgi [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] Calling method '>' {{(pid=105659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:42.612230 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: INFO nova.api.openstack.requestlog [None req-861d90b4-c5a1-4ba7-9aed-61de0cd55918 admin admin] 10.222.0.95 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 31 19:15:42.612682 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: [pid: 105659|app: 0|req: 40/79] 10.222.0.95 () {56 vars in 1074 bytes} [Wed Aug 31 19:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:15:42.805537 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG nova.api.openstack.wsgi [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Calling method '>' {{(pid=105660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:15:42.809036 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.809509 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.809934 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.810642 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:15:42.811088 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:15:42.811505 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: DEBUG oslo_concurrency.lockutils [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:15:42.834746 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: INFO nova.api.openstack.requestlog [None req-4e598906-4d63-4c1f-8d29-80b909099408 admin admin] 10.222.0.95 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083727 Aug 31 19:15:42.835468 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: [pid: 105660|app: 0|req: 40/80] 10.222.0.95 () {60 vars in 1193 bytes} [Wed Aug 31 19:15:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:16:45.579682 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: Wed Aug 31 19:16:45 2022 - graceful shutdown triggered... Aug 31 19:16:45.580550 dv-cinder-852210-6-iscsi devstack@n-api.service[105660]: Gracefully killing worker 2 (pid: 105660)... Aug 31 19:16:45.579750 dv-cinder-852210-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 19:16:45.581992 dv-cinder-852210-6-iscsi devstack@n-api.service[105659]: Gracefully killing worker 1 (pid: 105659)... Aug 31 19:16:46.580705 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: worker 1 buried after 1 seconds Aug 31 19:16:46.581374 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: worker 2 buried after 1 seconds Aug 31 19:16:46.581374 dv-cinder-852210-6-iscsi devstack@n-api.service[105658]: goodbye to uWSGI. Aug 31 19:16:46.582268 dv-cinder-852210-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 19:16:46.582819 dv-cinder-852210-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 19:16:46.585718 dv-cinder-852210-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 19:16:46.598487 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:16:46 2022] *** Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: nodename: dv-cinder-852210-6-iscsi Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: machine: x86_64 Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: clock source: unix Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: pcre jit disabled Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: detected number of CPU cores: 4 Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: current working directory: / Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: your processes number limit is 47680 Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: your memory page size is 4096 bytes Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: detected max file descriptor number: 2048 Aug 31 19:16:46.601850 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: lock engine: pthread robust mutexes Aug 31 19:16:46.603302 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: thunder lock: enabled Aug 31 19:16:46.603302 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 19:16:46.603302 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:16:46.642395 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: Python main interpreter initialized at 0x5574cca129c0 Aug 31 19:16:46.642395 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: python threads support enabled Aug 31 19:16:46.642395 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: your server socket listen backlog is limited to 100 connections Aug 31 19:16:46.642395 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:16:46.642866 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:16:46.642866 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: *** Operational MODE: preforking *** Aug 31 19:16:46.643133 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:16:46.643133 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: spawned uWSGI master process (pid: 120687) Aug 31 19:16:46.643432 dv-cinder-852210-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 19:16:46.643932 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: spawned uWSGI worker 1 (pid: 120706, cores: 1) Aug 31 19:16:46.644604 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: spawned uWSGI worker 2 (pid: 120707, cores: 1) Aug 31 19:16:46.644604 dv-cinder-852210-6-iscsi devstack@n-api.service[120687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:16:47.318718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:16:47.337408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:16:48.495563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:48.495563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: from cryptography.utils import int_from_bytes Aug 31 19:16:48.496243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:48.496243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: from cryptography.utils import int_from_bytes Aug 31 19:16:48.551258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:48.551258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: from cryptography.utils import int_from_bytes Aug 31 19:16:48.551909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:48.551909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: from cryptography.utils import int_from_bytes Aug 31 19:16:51.018423 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:16:51.019005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:16:51.019273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:16:51.019684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:16:51.019941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:16:51.020333 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.020733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.021066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.021387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.021723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.022078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.022442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.023652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.024002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.024322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.024748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.025088 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-6-iscsi {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.025595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.025913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.026232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.026561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.026872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.027204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.027516 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.028026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.028643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.028888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.029112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.029472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.029985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.030181 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.030396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.030717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.031048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.031354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.031790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-6-iscsi {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.032098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.032422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.032760 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.033197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.033514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.033839 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.034161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.034494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.034857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.035206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.035533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.035842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.036178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.036476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.036817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.037130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.037455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.037764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.038072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.038855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.039174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.039908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.040649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.041079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.041340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.041598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.041926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.042252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.042571 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.042884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.043196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.043507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.043817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.044127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.044435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.044777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.045106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.045427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.046541 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.046864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.047926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.047926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.047926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.048218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.048616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.048945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.049243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.049573 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.049910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.050223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.050537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.050849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.051172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.051499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.051808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.052065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.052373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.052709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.053037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.053347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.053658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.054127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.055403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.055403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.055661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.055979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.056299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.056719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.057039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.057555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.058046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.058370 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.058719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.059265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.059817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.060149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.060473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.060822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.061158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.061501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.061818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.062157 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.062470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.062793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.063117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.063430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.063736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.064354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.064706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.065023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.065348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.065657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.065960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.066272 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.066579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.066888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.067197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.067506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.067821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.068128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.068449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.068815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.069131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.069437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.070300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.070623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.070968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.071305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.071655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.071975 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.072311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.072674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.072996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.073309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.073627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.073956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.074271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.074582 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.074897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.075219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.075538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.075873 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.076193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.076514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.076865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.077179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.077500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.077834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.078172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.078480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.078824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.079177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.079497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.079823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.080151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.080478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.080819 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.081134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.081459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.081806 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.082122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.082445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.082828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.083082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.083590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.083817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.084790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.084790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.084790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.085189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.085874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.086199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.087114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.087337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.087670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.088105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.088427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.088859 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.089171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.089482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.089798 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.090116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.090426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.090771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.091100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.092071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.092449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.092884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.093185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.093502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.093869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.094181 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.094504 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.094868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.095356 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.095691 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.096010 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.096323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.096689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.097004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.097379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.097750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.098068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.098408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.098702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.099137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.099414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.099734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.100053 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.100388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.100748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.101094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.101441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.101756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.102281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.102824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.103275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.103593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.103949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.104311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.104720 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.105037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.105350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.105732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.105969 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:16:51.106439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.106563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:16:51.106697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.106697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.106950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:16:51.107042 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.107136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:16:51.107354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.107508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:16:51.107664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.107760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.107972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.108079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.108321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.108430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.108653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.108764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.109005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.109100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.109331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.109430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.109659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.109762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.109985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.110088 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.110303 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.110399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.110568 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.110677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.110887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.110991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.111218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-6-iscsi {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.111320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.111538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.111694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.111854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.112013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.112181 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.112340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.112498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.112666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.112861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.112968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.113177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.113297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.113507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.113647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.113824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.114111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.114278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.114419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.114510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.114728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.114833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.115044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.115151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.115607 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.115729 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.115827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.116134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.116352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.116474 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.116555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.116714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.116890 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.116997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.117176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.117317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.117498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.117642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.117913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.118017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-6-iscsi {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.118232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.118342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.118548 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.118649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.118859 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.118964 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.119192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.119332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.119492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.119636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.123120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.123312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.123455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.123598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.123743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.123892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.124025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.124170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.124311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.124452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.130508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.131275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.131405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.131527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.131652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.131767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.131888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.132018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.132669 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.132788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.132901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.133027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.134170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.134333 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.134472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.134614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.134746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.134887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.134981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.135083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.135179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.135267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.135352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.135438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.135537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.135632 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.135726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.135820 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.135916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.136004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.136004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.136177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.136270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.136364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.136450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.136548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.136685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.136774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.136869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.136955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.137050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.137146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.137234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.137319 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.137412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.137498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.137592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.139209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.139341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.139465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.139581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.139702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.139816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.139939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.140062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.140175 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.140298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.140417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.140541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.140728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.140728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.144471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.145226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.145388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.95 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.145528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.145670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.95 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.145803 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.145935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.146064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.146211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.146351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.146490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.146634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.146766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.146903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.147049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.147180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.147311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.147440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.147571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.147716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.148401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.148540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.148764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.148899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.149020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.149142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.149276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.149390 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.149521 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.149643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.149788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.149943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.150081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.150212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.150356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.150489 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.150622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.150768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.153386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.153602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.153745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.153896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.154062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.154168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.154260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.154347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.154434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.154434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.154662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.154756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.154920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.155070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.155227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.155374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.155529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.155683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.155852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.156014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.156014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.156014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.156014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.156014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.156740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.156899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.157127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.157292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.157292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.157576 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.157738 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.157895 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.158042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.158194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.158349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.158505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.158651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.158791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.158938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.159078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.159232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.159383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.159533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.159677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.159842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.159991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.160141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.160241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.160336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.160423 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.160515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.160652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.160750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.160845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.160933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.161018 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.161103 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.161198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.161295 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.161382 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.161476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.161571 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.161659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.161659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.161834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.161972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.162071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.162207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.162297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.162398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.162487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.162579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.162673 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.162767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.162862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.162950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.163046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.163142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.163262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.163419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.163523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.163623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.163623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.163786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.163874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:51.164007 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.164905 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.165028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.165148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.165269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.165654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.165780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.165913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166056 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.166892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.167943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168033 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168495 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.168905 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.169999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170098 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170285 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170464 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.170921 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171023 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171642 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.171926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172606 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.172946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.173885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174032 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.174743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175632 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.175899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.176861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177336 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.177928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.178741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.179126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.179515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.179860 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.180372 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.180870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.181006 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.181286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.181592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.181793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.181927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.182976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.183098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.183380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.183537 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.183772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.184091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.184383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.184383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.184679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.184913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.185058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.185275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.185545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.185680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.185856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.186239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.186507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.186819 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.187134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.187448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.187592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.187764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.188073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.188208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.188526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.188889 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.189195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.189332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.189624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.189838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.189974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.190243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.190571 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.190715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.190932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.191222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.191365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.191666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.191857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.192002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.192294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.192520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.192728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.192939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.193251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.193401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.193570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.193906 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.194058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.194217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.195050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.195362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.195557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.195694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.195988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.196548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.196781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.196929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.197070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.197361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.197787 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.198105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.198332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.198469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.198740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.199069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.199243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.199400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.199732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.200041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.200188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.200321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.200680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.200864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.201020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.201325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.201544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.201679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.201988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.202249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.202466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.202602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.202897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.203198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.203341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.203632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.203961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.204143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.204279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.204616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.204880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.205026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.205247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.205557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.205694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.205874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.206185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.206496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.206664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.206828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.207141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.207460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.207776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.208092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.208235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.208401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.208736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.209068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.209226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.209431 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.209760 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.209894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.210081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.211045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.211301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.211437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.211629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.211923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.212073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.212261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.212539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.212709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.212894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.213205 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.213340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.213556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.213869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.214004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.214195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.214533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.214853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.214997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.215167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.215505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.215765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.215900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.216153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.216465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.216636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.216893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.217205 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.217514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.217830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.218141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.218285 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.218451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.218761 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.218896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.219076 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.219382 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.219691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.219833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.219996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.220327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.220472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.220649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.220846 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.221029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.221278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.221414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.221588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.221785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.221921 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.222190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.222335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.222542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.222716 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.222859 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.223171 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.223320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.223483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.223675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.223821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.225073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.225253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.225398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.225539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.225686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.226338 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.226555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.226725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.226867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.227858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.228014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.228314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.228602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.228762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.228919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.229074 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.229230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.229499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.229674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.229821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.229966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.230122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.230277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.230430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.230576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.230748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.230903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231063 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.231977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.232132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.232284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.232437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.232633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.232801 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.232955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.233110 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.233264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.233569 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.233734 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.233893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.234049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.234194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.234339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.234540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.234712 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.234872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.235946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.236097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.236243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.236394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.236641 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.236812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.237013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.237167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.237314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.237471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.237674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.237989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.238272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.238425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.238605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.238772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.238926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.239071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.239221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.239372 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.239564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.239731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.239878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.240034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.240187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.240333 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.240476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.240676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.240915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.241066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.241212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.241362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.242242 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.242468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.242672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.242829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.242990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.243143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.243299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.243451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.243680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.243840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.243994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.244138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.244293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.244438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.244626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.244790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.244943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.245105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.245276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.245431 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.245577 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.245727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.245880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.246033 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.246189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.246335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.246480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.246632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.246833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.247195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.247354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.247818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.248254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.248510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.248779 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.249155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.249402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.249639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.249832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.249832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.250125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.250281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.250451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.250607 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.250762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.250908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251504 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.251958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.252114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.252260 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.252426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.252621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.252777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.252936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.253083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.253227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.253372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.253731 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.253896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254338 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.254968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.255113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.255258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.255412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.255575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.255734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.255886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.256039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.256192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.256415 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.256620 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.256786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.256941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.257642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.257931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.258249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.258560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.258868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.259020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.259210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.259364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.259543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.259705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.260044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.260228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.260386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.260548 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.260726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.260887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.261931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.262125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.262295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.262512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.262671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.263103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.263260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.263453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.263608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.263784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.263940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.264135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.264300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.264468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.264662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.264824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.264980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.265133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.265289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.265444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.265591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.265742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.265898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.266044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.266204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.266359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.266623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.266785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.266944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.267241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.267404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.267558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.267713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.267858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.268158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.268475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.268836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.269074 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.269298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.269717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.269897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.269897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.270400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.270400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.270713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.271104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.271757 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.271757 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.272055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.272250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.272584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.273331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.273488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.273645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.273792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.274052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.274213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.274391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.274658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.274810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.274956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.275109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.275264 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.275430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.275588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.275743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.275898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.276052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.276329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.276489 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.276776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.276941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.277088 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.277234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.277379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.277585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.277764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.277928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.278082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.278255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.278451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.278615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.278918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.279251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.279412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.279582 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.279746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.279916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.280099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.280259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.280406 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.280551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.280777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.280943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.281098 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.281250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.281404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.281559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.281715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.281862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.282041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.282206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.282379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.282685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.282856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.283003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.283211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.283365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.283576 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.283736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.283906 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.284081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.284234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.284462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.284719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.284875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.285106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.285258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.285412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.285559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.285703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.285994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.286154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.286308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.286513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.286666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.286879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.287053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.287200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.287473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.287626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.287809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.288134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.288324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.288480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.288825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.289142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.289479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.289646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.289856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.290022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.290301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.290729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.290913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.291077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.291233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.291387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.291558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.291795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.291947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.292132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.292286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.292496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.292834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.292995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.293143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.293299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.293453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.293601 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.293754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.293908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.294081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.294249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.294397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.294552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.294717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.294864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295312 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.295951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.296104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.296272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.296439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.296637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.296947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.297264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.297434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.297589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.297743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.297888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.298081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.298234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.298380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.298526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.298780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.299094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.299413 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.299566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.299721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.299874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.300043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.300205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.300361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.300602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.300761 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.300975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.301127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.301295 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.301467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.301625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.301771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.302028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.302212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.302370 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.302518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.302664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.302884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.303041 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.303235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.303397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.303552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.303711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.303858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:16:51.304109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.304319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.304590 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.304916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.305240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.305550 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.305872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.306189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.306569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.306886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.307196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.307589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.308055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.308432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.309524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.309867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.310204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.310513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.310874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.311170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.311485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.312048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.312252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.312591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.312910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.313361 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.313686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.314009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.314313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.314628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.314949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.315256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.315588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.315897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.316204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.316517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.316887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.317206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.317574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.318022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.318462 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.319072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.320549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.320896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.321218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.321547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.321870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.322210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.322642 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.322976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.323288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.323653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.324193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.324531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.325053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.325389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.325700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.326223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.326539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.326868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.327180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.327573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.328049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.328598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.329230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.330215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.330542 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.330858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.331188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.331565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.331927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.332267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.332554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.332895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.333229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.333751 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.333985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.334243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.334561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.334886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.335310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.336147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.336475 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.336928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.337255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.337637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.337974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.338561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.338885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.339590 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.340090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.340410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.340747 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.341176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.341487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.341809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.342904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.342904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.342904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.343492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.343492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.343848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.344178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.344374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.344661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.344983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.345291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.345613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.345933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.346236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.346543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.346849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.347195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.347499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.347888 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.348231 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.348793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.349135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.349973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.350313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.350641 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.351010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.351339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.351748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.352060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.352373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.352703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.353062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.353317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.353628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.353940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.354304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.354575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.354896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.355205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.355524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.355836 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.356148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.356451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.356856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.357282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.357600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.357999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.358320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.358885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.359214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.359951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.360387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.360739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.361056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.361376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.361697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.362008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.362332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.362649 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.362968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.363536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.363866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.364204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.364521 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.364883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.365199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.365514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.365834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.366146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.367075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.367455 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.368126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.368460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.369064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.369677 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.370249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.370583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.370908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.371230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.371750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.372082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.372398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.372744 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.373133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.373485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.373807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.374121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.374439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.374788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.375102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.375480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.375894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.376107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.376388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.376748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.377082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.377402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.378218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.378218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.378639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.379351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.380476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.381072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.381555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.382230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.383130 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.383880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.384046 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.384234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.384506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Registered counter for database nova_api Aug 31 19:16:51.384813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.385084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.385217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.385508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.385826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.386143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.386468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.386785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.387371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.387732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.388136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.388476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.389172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.389673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.390555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.390911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.391329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.391701 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.392176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.392635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.392867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.393181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.393502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.394249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.394249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.394532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.394818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.395203 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.395505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.395811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.396126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.396445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.396775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.397085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.397398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.398078 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.398413 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.398720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.399034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.399371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.399708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.400182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.400556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.400928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.401365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.401677 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.403483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.403483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.404190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.404190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.407653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.409293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.409293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.409293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.409293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.409992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.410363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.411819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.411819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.411819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.411819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.412940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.412940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.412940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.412940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.413555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.413555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.413857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.414223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.414514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.414836 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.415151 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.415730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.415900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.416260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.416446 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.416975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.417171 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.417349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.417670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.418048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.418364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.418689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.419011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.419326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.419652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.420038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.420406 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.420770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.421128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.421470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.421837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.422165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.423982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.423982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.423982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.423982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.423982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.423982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.426013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.426013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.426013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.426013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.426013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.426013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.427520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.427520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.427932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.428084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.428284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.428604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.429756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.430051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.430453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.430697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.430987 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.431292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.431626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.431963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.432282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.432626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.432944 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.433271 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.434277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.434277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.434277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.434691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.434885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.435220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.435529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.435838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.436155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.436468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.436847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.437707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.437707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.439851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.440988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.440988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.440988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.440988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.441488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.441488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.441750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.442095 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.442374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.442690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.443027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.443379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.443956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.445158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.445158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.445158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.447678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:51.448106 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:16:51.475815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.context [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95c90422-9fe5-49ea-9d04-23948be25350(cell1) {{(pid=120707) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:16:51.479810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.480291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.481945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.482690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.483140 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.485195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.487193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Registered counter for database nova_cell0 Aug 31 19:16:51.491679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Registered counter for database nova_cell1 Aug 31 19:16:51.499474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.500691 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.507808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.509194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.511053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Registered counter for database nova_api Aug 31 19:16:51.532930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.540157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.597866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.context [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95c90422-9fe5-49ea-9d04-23948be25350(cell1) {{(pid=120706) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:16:51.602639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.603115 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.604714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.605449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:51.605903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:51.607910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:51.610004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Registered counter for database nova_cell0 Aug 31 19:16:51.614193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Registered counter for database nova_cell1 Aug 31 19:16:51.622356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.624726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.631729 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.633841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.663258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO dbcounter [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Registered counter for database nova_cell0 Aug 31 19:16:51.671667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.676419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writer thread running {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:51.787052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO dbcounter [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Registered counter for database nova_cell0 Aug 31 19:16:51.794536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_db.sqlalchemy.engines [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:51.799188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writer thread running {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:52.005629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:52.014094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:52.136091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:52.144530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:52.379073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:52.385745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: WARNING keystonemiddleware.auth_token [None req-8a2e124d-2173-4472-a8a0-c88c69b3a24d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:52.391289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574cca129c0 pid: 120707 (default app) Aug 31 19:16:52.506520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:52.513497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: WARNING keystonemiddleware.auth_token [None req-7e81e8c0-24ca-43ee-aa8e-e460861089dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:52.518895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574cca129c0 pid: 120706 (default app) Aug 31 19:17:29.988130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:29.989811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:29.992946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:29.994553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:30.157619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:30.158591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:30.159359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:30.161957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:30.476119 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1895d404-36b8-4774-a3fa-2bf9faf91b82 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f9760ab3c10>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:30.869543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1895d404-36b8-4774-a3fa-2bf9faf91b82 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/b25c6ae2-726f-45ef-a851-6ffd634baf12" status: 200 len: 350 microversion: 2.1 time: 0.717126 Aug 31 19:17:30.877283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 1/1] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:30 2022] GET /compute/v2.1/os-volumes/b25c6ae2-726f-45ef-a851-6ffd634baf12 => generated 350 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:30.981166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ed47912e-6b83-4368-8120-52eb2e378ef5 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Action: 'create', calling method: .version_select at 0x7f976097cee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1170028860", "metadata": {"Type": "work"}}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ed47912e-6b83-4368-8120-52eb2e378ef5 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Request method failure captured: Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 122 Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PKAs6gNWbfD56U06qWlPaHJc145Kw6P3VZubV1lQobQ_5S6m41BCzmW_Qic6arpFYAYwEeaUwYVXMNCGuR944o_CnIhevYHZLHdRizbZxishu9nSbA4L4mgVV_gh5Hg0U7qsYE4BU2wY8EG3qhJk3f24u9hjuXBBZY527HtvHylbQ Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:30.995370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 782f913b34bf41c394642799049dc4ed Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1170028860", "metadata": {"Type": "work"}}} Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:30.997136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1170028860', 'metadata': {'Type': 'work'}}}} Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:30.998087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:17:30.999686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:17:31.001805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:17:31.001805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.002823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ed47912e-6b83-4368-8120-52eb2e378ef5 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:31.005848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ed47912e-6b83-4368-8120-52eb2e378ef5 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133040 Aug 31 19:17:31.007318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 2/2] 10.222.0.95 () {60 vars in 1156 bytes} [Wed Aug 31 19:17:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:17:31.033355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-76495c2b-8ee6-4e7a-a88a-5b9250d03455 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Action: 'create', calling method: .version_select at 0x7f97609084c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-158938642", "metadata": {"Type": "work"}}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-76495c2b-8ee6-4e7a-a88a-5b9250d03455 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Request method failure captured: Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 119 Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PKAs6gNWbfD56U06qWlPaHJc145Kw6P3VZubV1lQobQ_5S6m41BCzmW_Qic6arpFYAYwEeaUwYVXMNCGuR944o_CnIhevYHZLHdRizbZxishu9nSbA4L4mgVV_gh5Hg0U7qsYE4BU2wY8EG3qhJk3f24u9hjuXBBZY527HtvHylbQ Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:31.045614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 782f913b34bf41c394642799049dc4ed Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-158938642", "metadata": {"Type": "work"}}} Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:31.047009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-158938642', 'metadata': {'Type': 'work'}}}} Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi '0' Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:31.047775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:17:31.049144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:17:31.050285 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:17:31.050285 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.055094 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-76495c2b-8ee6-4e7a-a88a-5b9250d03455 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:31.058117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-76495c2b-8ee6-4e7a-a88a-5b9250d03455 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.044009 Aug 31 19:17:31.061012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 3/3] 10.222.0.95 () {60 vars in 1156 bytes} [Wed Aug 31 19:17:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 19:17:31.074953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-85615e96-102c-4996-9e16-b2c93bacaf3e tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Action: 'create', calling method: .version_select at 0x7f9761194a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-279055080", "metadata": {"Type": "work"}}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-85615e96-102c-4996-9e16-b2c93bacaf3e tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Request method failure captured: Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 118 Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PKAs6gNWbfD56U06qWlPaHJc145Kw6P3VZubV1lQobQ_5S6m41BCzmW_Qic6arpFYAYwEeaUwYVXMNCGuR944o_CnIhevYHZLHdRizbZxishu9nSbA4L4mgVV_gh5Hg0U7qsYE4BU2wY8EG3qhJk3f24u9hjuXBBZY527HtvHylbQ Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:31.089466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 782f913b34bf41c394642799049dc4ed Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-279055080", "metadata": {"Type": "work"}}} Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:31.091114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-279055080', 'metadata': {'Type': 'work'}}}} Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi '' Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:31.092064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:17:31.093628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:17:31.095256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:17:31.095256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.096890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-85615e96-102c-4996-9e16-b2c93bacaf3e tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:31.097954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-85615e96-102c-4996-9e16-b2c93bacaf3e tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031936 Aug 31 19:17:31.099066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 4/4] 10.222.0.95 () {60 vars in 1156 bytes} [Wed Aug 31 19:17:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:17:31.123742 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f39e37ab-7d07-46c9-a259-0fb616041bbc tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Calling method '.version_select at 0x7f976091b3a0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:31.217887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-f39e37ab-7d07-46c9-a259-0fb616041bbc tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] HTTP exception thrown: Volume tempest-invalid-265841912 could not be found. Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f39e37ab-7d07-46c9-a259-0fb616041bbc tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Request method failure captured: Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-265841912 HTTP/1.1 Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PKAs6gNWbfD56U06qWlPaHJc145Kw6P3VZubV1lQobQ_5S6m41BCzmW_Qic6arpFYAYwEeaUwYVXMNCGuR944o_CnIhevYHZLHdRizbZxishu9nSbA4L4mgVV_gh5Hg0U7qsYE4BU2wY8EG3qhJk3f24u9hjuXBBZY527HtvHylbQ Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:31.231301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 782f913b34bf41c394642799049dc4ed Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Volume tempest-invalid-265841912 could not be found. Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'tempest-invalid-265841912'} Aug 31 19:17:31.233750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-265841912 could not be found. (HTTP 404) (Request-ID: req-d73fd25a-6f73-4c6f-b177-7a23722622b2) Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.235124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:17:31.238651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-265841912 could not be found. Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:31.242648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-265841912 could not be found. Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-265841912 could not be found. Aug 31 19:17:31.246936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.248357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-88498a30-099e-4554-900e-949f77e31c76 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Action: 'create', calling method: .version_select at 0x7f9760a700d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1686766156"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:31.250347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f39e37ab-7d07-46c9-a259-0fb616041bbc tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Returning 404 to user: Volume tempest-invalid-265841912 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:31.252190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f39e37ab-7d07-46c9-a259-0fb616041bbc tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/tempest-invalid-265841912" status: 404 len: 98 microversion: 2.1 time: 0.144452 Aug 31 19:17:31.254827 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 5/5] 10.222.0.95 () {58 vars in 1215 bytes} [Wed Aug 31 19:17:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-265841912 => generated 98 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 19:17:31.270819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-73792dd3-5ac6-4aa0-a6f7-053f76cb9a75 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009495 Aug 31 19:17:31.271488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 6/6] 10.222.0.95 () {58 vars in 1140 bytes} [Wed Aug 31 19:17:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 19:17:31.281441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dfea287b-d96b-4b1f-9098-647b2c59b970 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003923 Aug 31 19:17:31.286003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 7/7] 10.222.0.95 () {58 vars in 1137 bytes} [Wed Aug 31 19:17:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 19:17:31.300467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5c2f06da-4fe0-4f8f-a8f7-5cae691ec520 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Calling method '.version_select at 0x7f976091bca0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:31.369399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-5c2f06da-4fe0-4f8f-a8f7-5cae691ec520 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] HTTP exception thrown: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5c2f06da-4fe0-4f8f-a8f7-5cae691ec520 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Request method failure captured: Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/os-volumes/e4c221f6-3150-4e5a-9dce-ce842ddb2a41 HTTP/1.1 Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PKAs6gNWbfD56U06qWlPaHJc145Kw6P3VZubV1lQobQ_5S6m41BCzmW_Qic6arpFYAYwEeaUwYVXMNCGuR944o_CnIhevYHZLHdRizbZxishu9nSbA4L4mgVV_gh5Hg0U7qsYE4BU2wY8EG3qhJk3f24u9hjuXBBZY527HtvHylbQ Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:31.372940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 782f913b34bf41c394642799049dc4ed Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'e4c221f6-3150-4e5a-9dce-ce842ddb2a41'} Aug 31 19:17:31.375819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. (HTTP 404) (Request-ID: req-4aa20de5-7f0e-444e-a5bf-af9ea8c08b97) Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.380113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:17:31.386430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:17:31.389058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5c2f06da-4fe0-4f8f-a8f7-5cae691ec520 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Returning 404 to user: Volume e4c221f6-3150-4e5a-9dce-ce842ddb2a41 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5c2f06da-4fe0-4f8f-a8f7-5cae691ec520 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/e4c221f6-3150-4e5a-9dce-ce842ddb2a41" status: 404 len: 109 microversion: 2.1 time: 0.077733 Aug 31 19:17:31.392505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 8/8] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:17:31 2022] DELETE /compute/v2.1/os-volumes/e4c221f6-3150-4e5a-9dce-ce842ddb2a41 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:17:31.397827 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-778c9980-23e8-438c-8fdd-c50fa8669fc4 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Calling method '.version_select at 0x7f976091b0d0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:31.500112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-778c9980-23e8-438c-8fdd-c50fa8669fc4 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] HTTP exception thrown: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-778c9980-23e8-438c-8fdd-c50fa8669fc4 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Request method failure captured: Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/22d45ae2-f0e3-4c58-a359-27f04228eb46 HTTP/1.1 Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PKAs6gNWbfD56U06qWlPaHJc145Kw6P3VZubV1lQobQ_5S6m41BCzmW_Qic6arpFYAYwEeaUwYVXMNCGuR944o_CnIhevYHZLHdRizbZxishu9nSbA4L4mgVV_gh5Hg0U7qsYE4BU2wY8EG3qhJk3f24u9hjuXBBZY527HtvHylbQ Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:31.502180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/2fc2cc05aa8a4b1e8c729315f6c85256"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 2fc2cc05aa8a4b1e8c729315f6c85256 Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-993423503 Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 782f913b34bf41c394642799049dc4ed Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-993423503-project Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '22d45ae2-f0e3-4c58-a359-27f04228eb46'} Aug 31 19:17:31.503788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. (HTTP 404) (Request-ID: req-f85e7bae-ad62-42e2-a8fb-4f6f7d9f6647) Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.504798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:31.506261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:17:31.507579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-778c9980-23e8-438c-8fdd-c50fa8669fc4 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] Returning 404 to user: Volume 22d45ae2-f0e3-4c58-a359-27f04228eb46 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-778c9980-23e8-438c-8fdd-c50fa8669fc4 tempest-VolumesNegativeTest-993423503 tempest-VolumesNegativeTest-993423503-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/22d45ae2-f0e3-4c58-a359-27f04228eb46" status: 404 len: 109 microversion: 2.1 time: 0.125670 Aug 31 19:17:31.509009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 9/9] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:31 2022] GET /compute/v2.1/os-volumes/22d45ae2-f0e3-4c58-a359-27f04228eb46 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:17:32.297498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-88498a30-099e-4554-900e-949f77e31c76 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.324060 Aug 31 19:17:32.297498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 1/10] 10.222.0.95 () {60 vars in 1155 bytes} [Wed Aug 31 19:17:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2327 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 19:17:32.312810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-194f723f-9e8d-4f25-8d39-5802f1482212 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f9760908dc0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:32.433325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-194f723f-9e8d-4f25-8d39-5802f1482212 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 200 len: 345 microversion: 2.1 time: 0.124170 Aug 31 19:17:32.433899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 10/11] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:32 2022] GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:32.557461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ec76f98f-0ab5-42e9-a58f-e095b13bcb98 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f9760941f70>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:32.654055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ec76f98f-0ab5-42e9-a58f-e095b13bcb98 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/38d6e3b5-776e-46e2-8069-65ff19f7a252" status: 200 len: 350 microversion: 2.1 time: 0.103206 Aug 31 19:17:32.654684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 2/12] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:32 2022] GET /compute/v2.1/os-volumes/38d6e3b5-776e-46e2-8069-65ff19f7a252 => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:33.448040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ae285768-4a02-4458-b637-93127ea575dc tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976091bb80>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:33.516745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ae285768-4a02-4458-b637-93127ea575dc tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 200 len: 346 microversion: 2.1 time: 0.072928 Aug 31 19:17:33.527181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 11/13] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:33 2022] GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:33.531973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5080ee06-0d20-46dd-ab9d-f8af49cb3c00 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Action: 'create', calling method: .version_select at 0x7f9760958700>, body: {"snapshot": {"volume_id": "dc1eece6-be74-4cd0-9196-3c888bc621e1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1929484229"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:34.070353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5080ee06-0d20-46dd-ab9d-f8af49cb3c00 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.541361 Aug 31 19:17:34.070984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 3/14] 10.222.0.95 () {60 vars in 1162 bytes} [Wed Aug 31 19:17:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:34.083845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3852dbca-16e6-4245-bbba-b33407b29a5c tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976091baf0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.242838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2cd67c19-7cf5-4379-8fa5-5c22bed8806c tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f976095a820>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.343137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2cd67c19-7cf5-4379-8fa5-5c22bed8806c tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/d50e0f41-5d9a-4e8c-8be3-d43b2b009e98" status: 200 len: 351 microversion: 2.1 time: 0.104779 Aug 31 19:17:34.344374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 4/15] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-volumes/d50e0f41-5d9a-4e8c-8be3-d43b2b009e98 => generated 351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:34.360362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d528ec4b-306c-40a8-b0f9-1b0fedcee723 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f9760958d30>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.509363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3852dbca-16e6-4245-bbba-b33407b29a5c tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 287 microversion: 2.1 time: 0.429380 Aug 31 19:17:34.510005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 12/16] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 287 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:34.532245 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-58de9539-eaa2-4a7e-9f60-df865a865411 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f9760908f70>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.556351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d528ec4b-306c-40a8-b0f9-1b0fedcee723 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.201351 Aug 31 19:17:34.557258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 5/17] 10.222.0.95 () {58 vars in 1134 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:34.573127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-04749938-70e8-4a4a-9219-3c382d86eb95 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f976095aa60>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.608178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-58de9539-eaa2-4a7e-9f60-df865a865411 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.081592 Aug 31 19:17:34.613045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 13/18] 10.222.0.95 () {58 vars in 1140 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:34.636764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5e0b7c3f-e058-4810-88e2-4b4056cdbe6e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f97609084c0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.680028 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5e0b7c3f-e058-4810-88e2-4b4056cdbe6e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 287 microversion: 2.1 time: 0.061866 Aug 31 19:17:34.681460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 14/19] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:34.747772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-04749938-70e8-4a4a-9219-3c382d86eb95 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.178430 Aug 31 19:17:34.748346 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 6/20] 10.222.0.95 () {58 vars in 1149 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:17:34.769045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f73f0360-ad5a-420d-b808-9685f6329b9a tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f9760908af0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:34.896276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f73f0360-ad5a-420d-b808-9685f6329b9a tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.131505 Aug 31 19:17:34.899616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 15/21] 10.222.0.95 () {58 vars in 1134 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:34.917891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c573f5b5-016d-4056-ab20-6d7a7ec463fb tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f9760958a60>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.044116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c573f5b5-016d-4056-ab20-6d7a7ec463fb tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.132469 Aug 31 19:17:35.046255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 7/22] 10.222.0.95 () {58 vars in 1167 bytes} [Wed Aug 31 19:17:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:35.064228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-209d0424-929b-4c33-8eac-563ae02269c5 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f976093a940>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.252056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-209d0424-929b-4c33-8eac-563ae02269c5 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.191601 Aug 31 19:17:35.272039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3954ae90-b502-49f8-bd7c-d9318469e13a tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f976095ad30>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.272902 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 16/23] 10.222.0.95 () {58 vars in 1170 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:35.502448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3954ae90-b502-49f8-bd7c-d9318469e13a tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.237772 Aug 31 19:17:35.503341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 8/24] 10.222.0.95 () {58 vars in 1155 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:35.532238 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5c686049-3dfc-4568-9c10-2639f32dd2a9 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f976093aaf0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.650844 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5c686049-3dfc-4568-9c10-2639f32dd2a9 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.124489 Aug 31 19:17:35.651422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 17/25] 10.222.0.95 () {58 vars in 1188 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:35.667945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7b0292ac-cb69-4599-9ea7-5fbf18eae9c1 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] Calling method '.version_select at 0x7f97608e9430>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.702067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d055b94d-fdff-411c-a576-c104065906f4 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f9760915d30>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.789651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d055b94d-fdff-411c-a576-c104065906f4 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 287 microversion: 2.1 time: 0.099490 Aug 31 19:17:35.792723 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 18/26] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:35.844686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7b0292ac-cb69-4599-9ea7-5fbf18eae9c1 tempest-VolumesTestJSON-352628313 tempest-VolumesTestJSON-352628313-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.182097 Aug 31 19:17:35.846167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 9/27] 10.222.0.95 () {58 vars in 1155 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:36.814679 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7fc51af1-1fde-4da4-b6fc-c95212b1db2f tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f9760908b80>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:36.884921 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7fc51af1-1fde-4da4-b6fc-c95212b1db2f tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 287 microversion: 2.1 time: 0.080989 Aug 31 19:17:36.886174 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 19/28] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:36 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:37.899406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e1f6939-91d7-4d54-a0d4-ff872bdd910a tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976095a160>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:38.049554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e1f6939-91d7-4d54-a0d4-ff872bdd910a tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 287 microversion: 2.1 time: 0.155499 Aug 31 19:17:38.050964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 10/29] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:37 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:39.066800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-270b0a7a-e1be-47b2-aa68-2e5d9200d711 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976091bee0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:39.147079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-270b0a7a-e1be-47b2-aa68-2e5d9200d711 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 288 microversion: 2.1 time: 0.087455 Aug 31 19:17:39.149075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 20/30] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:39 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:39.163757 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6e43c564-4bd4-4846-b167-7cf45fde13b8 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f9760958940>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:39.325783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6e43c564-4bd4-4846-b167-7cf45fde13b8 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "DELETE /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 202 len: 0 microversion: 2.1 time: 0.168783 Aug 31 19:17:39.326481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 11/31] 10.222.0.95 () {58 vars in 1254 bytes} [Wed Aug 31 19:17:39 2022] DELETE /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:17:39.335313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0a690c5b-3511-49bb-9a28-c78b649e9440 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976091b820>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:39.455770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0a690c5b-3511-49bb-9a28-c78b649e9440 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 200 len: 287 microversion: 2.1 time: 0.124685 Aug 31 19:17:39.456750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 21/32] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:39 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:17:40.470476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ebc297d8-b343-4e82-8ecc-37ce1e73cbf2 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f97609580d0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:40.551224 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-ebc297d8-b343-4e82-8ecc-37ce1e73cbf2 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] HTTP exception thrown: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ebc297d8-b343-4e82-8ecc-37ce1e73cbf2 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Request method failure captured: Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 HTTP/1.1 Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PJNXK3CJWVietIV4lIzjDeKgS9VlzWEzeI1IcJL-B7VGlfLC5PigYMgurNEruO1kIqDSQRy9ei-jRtFVZh7d0k5Xc06j18i_zhtU8Onbb14tJtr7Hzoi8mejyr9nn9s-gmD8tJPc9_J9w75T5g94n14bmeDO7bQDel-B1lLU7Ukmk Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:17:40.555453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 50cc345e23a44acfb5dcf189a56124b1 Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '6e782100-1d4c-4014-821e-558e26805ef7'} Aug 31 19:17:40.556692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. (HTTP 404) (Request-ID: req-3e272a9c-17be-44b9-bc53-611942f7211c) Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:40.558347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 19:17:40.559439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ebc297d8-b343-4e82-8ecc-37ce1e73cbf2 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Returning 404 to user: Snapshot 6e782100-1d4c-4014-821e-558e26805ef7 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ebc297d8-b343-4e82-8ecc-37ce1e73cbf2 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7" status: 404 len: 111 microversion: 2.1 time: 0.091467 Aug 31 19:17:40.560420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 12/33] 10.222.0.95 () {58 vars in 1251 bytes} [Wed Aug 31 19:17:40 2022] GET /compute/v2.1/os-snapshots/6e782100-1d4c-4014-821e-558e26805ef7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:17:40.575980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e9d41ddd-8e0f-4894-8cc1-53bbf4d4697b tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976093a670>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:40.758285 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e9d41ddd-8e0f-4894-8cc1-53bbf4d4697b tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 202 len: 0 microversion: 2.1 time: 0.190182 Aug 31 19:17:40.758873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 22/34] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:17:40 2022] DELETE /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:17:40.766988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a8cb4306-d9b2-4ae5-824c-4e26bd0465d5 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f9760941ee0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:40.945546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a8cb4306-d9b2-4ae5-824c-4e26bd0465d5 tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 200 len: 345 microversion: 2.1 time: 0.182354 Aug 31 19:17:40.946113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 13/35] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:40 2022] GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:41.962219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f234f201-6c83-4455-ab02-8f84ce7699da tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976093a280>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:42.018414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-f234f201-6c83-4455-ab02-8f84ce7699da tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] HTTP exception thrown: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f234f201-6c83-4455-ab02-8f84ce7699da tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Request method failure captured: Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 HTTP/1.1 Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PJNXK3CJWVietIV4lIzjDeKgS9VlzWEzeI1IcJL-B7VGlfLC5PigYMgurNEruO1kIqDSQRy9ei-jRtFVZh7d0k5Xc06j18i_zhtU8Onbb14tJtr7Hzoi8mejyr9nn9s-gmD8tJPc9_J9w75T5g94n14bmeDO7bQDel-B1lLU7Ukmk Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:42.020671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 50cc345e23a44acfb5dcf189a56124b1 Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'dc1eece6-be74-4cd0-9196-3c888bc621e1'} Aug 31 19:17:42.022388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. (HTTP 404) (Request-ID: req-e732703a-c0e0-4cf9-b078-4f09e7a98e96) Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.023061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:42.024131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:17:42.025259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.026296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.028048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f234f201-6c83-4455-ab02-8f84ce7699da tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Returning 404 to user: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:42.029143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f234f201-6c83-4455-ab02-8f84ce7699da tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 404 len: 109 microversion: 2.1 time: 0.073444 Aug 31 19:17:42.030215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 23/36] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:41 2022] GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:17:42.045084 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4fa83937-987c-461d-81be-5562b6d8864e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f97608e9b80>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:42.118004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-4fa83937-987c-461d-81be-5562b6d8864e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] HTTP exception thrown: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4fa83937-987c-461d-81be-5562b6d8864e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Request method failure captured: Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 HTTP/1.1 Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PJNXK3CJWVietIV4lIzjDeKgS9VlzWEzeI1IcJL-B7VGlfLC5PigYMgurNEruO1kIqDSQRy9ei-jRtFVZh7d0k5Xc06j18i_zhtU8Onbb14tJtr7Hzoi8mejyr9nn9s-gmD8tJPc9_J9w75T5g94n14bmeDO7bQDel-B1lLU7Ukmk Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:17:42.120499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 50cc345e23a44acfb5dcf189a56124b1 Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'dc1eece6-be74-4cd0-9196-3c888bc621e1'} Aug 31 19:17:42.121596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. (HTTP 404) (Request-ID: req-779d5805-89a4-48b6-a4cd-b14834ecaaf5) Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.122220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:17:42.123147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:17:42.124064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.124956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.126369 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4fa83937-987c-461d-81be-5562b6d8864e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Returning 404 to user: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:42.127371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4fa83937-987c-461d-81be-5562b6d8864e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 404 len: 109 microversion: 2.1 time: 0.086155 Aug 31 19:17:42.128149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 14/37] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:17:42 2022] DELETE /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:17:42.137159 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ad33704-4db4-468c-aeb5-ef509ae2c75e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Calling method '.version_select at 0x7f976093a040>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:42.189873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-4ad33704-4db4-468c-aeb5-ef509ae2c75e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] HTTP exception thrown: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ad33704-4db4-468c-aeb5-ef509ae2c75e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Request method failure captured: Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 HTTP/1.1 Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PJNXK3CJWVietIV4lIzjDeKgS9VlzWEzeI1IcJL-B7VGlfLC5PigYMgurNEruO1kIqDSQRy9ei-jRtFVZh7d0k5Xc06j18i_zhtU8Onbb14tJtr7Hzoi8mejyr9nn9s-gmD8tJPc9_J9w75T5g94n14bmeDO7bQDel-B1lLU7Ukmk Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:17:42.192004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1ecdbc1a962e47a2b1885519551b23e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1ecdbc1a962e47a2b1885519551b23e6 Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-737099747 Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 50cc345e23a44acfb5dcf189a56124b1 Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-737099747-project Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'dc1eece6-be74-4cd0-9196-3c888bc621e1'} Aug 31 19:17:42.193637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. (HTTP 404) (Request-ID: req-cfe6c9be-9595-4698-a87c-9a99ec3c6029) Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.195061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:17:42.197612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:17:42.200752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ad33704-4db4-468c-aeb5-ef509ae2c75e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] Returning 404 to user: Volume dc1eece6-be74-4cd0-9196-3c888bc621e1 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4ad33704-4db4-468c-aeb5-ef509ae2c75e tempest-VolumesSnapshotsTestJSON-737099747 tempest-VolumesSnapshotsTestJSON-737099747-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1" status: 404 len: 109 microversion: 2.1 time: 0.060145 Aug 31 19:17:42.203848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 24/38] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:17:42 2022] GET /compute/v2.1/os-volumes/dc1eece6-be74-4cd0-9196-3c888bc621e1 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:17:44.712274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-035abf61-4b13-4fe7-85fb-195440f1440e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'create', calling method: .version_select at 0x7f97608e9a60>, body: {"keypair": {"name": "tempest-keypair-381430543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnJr6FxmpHYQBBq+28LUl5RwTqHuxOLwLZrP4ab85cO0L8ierF5ahnjVMgxw2WhcawRPlToptLW7NfIcLSkKC2o2MB1Xs0NDOaudPPh+tHgbfdHXqBVD1Ttp17yjZNI0g=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:44.770151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-035abf61-4b13-4fe7-85fb-195440f1440e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:44.777831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-035abf61-4b13-4fe7-85fb-195440f1440e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for user 25c3f0a2e1fd4067b1804ef42faa46d5 and project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:44.896099 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-035abf61-4b13-4fe7-85fb-195440f1440e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.586481 Aug 31 19:17:44.897069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 15/39] 10.222.0.95 () {62 vars in 1200 bytes} [Wed Aug 31 19:17:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 588 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 19:17:48.598992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-acf1c678-2aa5-4050-b675-bc069268acdf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: .version_select at 0x7f9760833310>, body: {"keypair": {"name": "tempest-keypair-1510874253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQWfy8zzTKF00mUJDwlVfI7/bf13rzQ1VnoAp2h4dNRyxaiXBBQz9SYLVq10UhapCJef9yZNC+ituQw6RqvbBl4szcZ71GWeEplTrzliAD49LE19AdypMITf1+FFvGKyA=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:48.643128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dc146b64-3689-4302-8cb7-7eec7ac40927 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: .version_select at 0x7f976093a3a0>, body: {"keypair": {"name": "tempest-keypair-2014196407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw50/47T+GhT3utBEbZCBm1Vp7RclAvVb2Om/Q6rhD0RcZQeAEdHcUnriXL3xnHsc2KZWuVGXsLxeGdeEgQpIKm+YO5DjzEBqdcw4EX7R/ovfKnFKYYCFmYUwDfmYi8Wg=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:48.648344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-acf1c678-2aa5-4050-b675-bc069268acdf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:48.667271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-acf1c678-2aa5-4050-b675-bc069268acdf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for user a288c513afd94adaa9f53f9f65dc9dd8 and project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:48.762079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-acf1c678-2aa5-4050-b675-bc069268acdf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.860615 Aug 31 19:17:48.763444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 16/40] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:17:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:48.813303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-dc146b64-3689-4302-8cb7-7eec7ac40927 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:48.829173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-dc146b64-3689-4302-8cb7-7eec7ac40927 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:48.953083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dc146b64-3689-4302-8cb7-7eec7ac40927 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.135280 Aug 31 19:17:48.953941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 25/41] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:17:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:50.170439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1537818021", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "networks": [{"uuid": "5d200c27-2681-4c5f-bb95-d1fb0638c96c"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:50.391526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] validate_networks() for [('5d200c27-2681-4c5f-bb95-d1fb0638c96c', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:51.239060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1862762065", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:51.461151 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] validate_networks() for [('201376f0-1504-4d78-ac2c-2c94758d5b0e', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:53.785580 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:17:53.786072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:17:53.786519 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:17:53.787458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:17:53.787880 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:17:53.803074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:53.803568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:53.804078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:53.804784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:53.805670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:53.805670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:53.874323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Getting quotas for project 9ccec772d24645ce8f5e58de8ee5e47c. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:53.890027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Getting quotas for user 97c9201758884fdbb080f85337a5ce87 and project 9ccec772d24645ce8f5e58de8ee5e47c. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:53.915850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:17:53.918840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:17:54.048207 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c2b409ae-79c7-47e7-b397-35499735349e tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.350633 Aug 31 19:17:54.057143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 17/42] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:17:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:17:54.073842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1669766664", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1737780-76b7-4e42-889e-c8e6f7b5ceb1"}], "security_groups": [{"name": "tempest-securitygroup--31105463"}], "key_name": "tempest-keypair-381430543", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:54.408941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:17:54.410189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:17:54.410959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:17:54.412117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:17:54.412807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:17:54.432796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:54.433628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:54.434313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:54.435388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:54.445338 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:54.446057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:54.492332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] validate_networks() for [('d1737780-76b7-4e42-889e-c8e6f7b5ceb1', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:54.519127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for project a1342c2dbb1c41dca6061505220d9de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:54.528034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for user fd0f7f51482040d7a89df3f7502c2638 and project a1342c2dbb1c41dca6061505220d9de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:54.556856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:17:54.559699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:17:54.706873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb7af98f-80ef-41ef-8051-6833712685ea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.831522 Aug 31 19:17:54.709219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 26/43] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:17:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:17:54.729283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1905318636", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65051338-00b4-459c-8f05-d190e2d29e4b"}], "security_groups": [{"name": "tempest-securitygroup--69115126"}], "key_name": "tempest-keypair-2014196407", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:55.509052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] validate_networks() for [('65051338-00b4-459c-8f05-d190e2d29e4b', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:56.360244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:17:56.360855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:17:56.361399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:17:56.361894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:17:56.362502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:17:56.379418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:56.381647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:56.383809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:56.385095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:56.394573 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:56.395279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:56.439797 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:56.453563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for user 25c3f0a2e1fd4067b1804ef42faa46d5 and project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:56.496901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:17:56.497853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:17:56.638068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bfcc4c19-1681-4737-b96b-a7cb4d3906e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.577325 Aug 31 19:17:56.639015 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 18/44] 10.222.0.95 () {62 vars in 1188 bytes} [Wed Aug 31 19:17:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 19:17:56.676611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:56.678781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:56.720810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:56.721994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:56.723753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:56.725961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:56.729200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:56.730086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:57.266588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:57.321814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-71a70940-2118-4aa6-be10-ceb86e2e8bde tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1219 microversion: 2.1 time: 0.637792 Aug 31 19:17:57.337255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 19/45] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:56 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1219 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:57.337255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:57.342729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:57.360724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:57.361387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:57.366092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:57.369197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:57.369687 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:57.370129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:57.537554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:57.566716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5a305a80-8f75-4d68-b3ed-1768743b32aa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1218 microversion: 2.1 time: 0.239512 Aug 31 19:17:57.596949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 20/46] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:57 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:57.621556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-757134070", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "435f217b-7ded-4e09-b4e3-095f27bf676c"}], "security_groups": [{"name": "tempest-securitygroup--2054180522"}], "key_name": "tempest-keypair-1510874253", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:57.631499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:17:57.632079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:17:57.634347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:17:57.641424 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:17:57.644960 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:17:57.699132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:57.701452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:57.705911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:57.708923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:57.711018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:57.715897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:57.837594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:57.850792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:57.888885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:17:57.891086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] validate_networks() for [('435f217b-7ded-4e09-b4e3-095f27bf676c', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:57.900302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:17:58.024190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-20f9c8db-7dd7-411d-80d1-85125125cbb2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.302948 Aug 31 19:17:58.026918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 27/47] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:17:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 3317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:17:58.045546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:58.046221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:58.071378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:58.072329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:58.072951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:58.073829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:58.074767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:58.075342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:58.416146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:58.441490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:58.444301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:17:58.445630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-673d08cd-6f2f-4876-ac8b-a42d66a8a808 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1285 microversion: 2.20 time: 0.417360 Aug 31 19:17:58.446981 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 28/48] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:17:58 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1285 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:17:58.467291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1405323786", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:58.594091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] validate_networks() for [('201376f0-1504-4d78-ac2c-2c94758d5b0e', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:17:59.349842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:17:59.351328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:17:59.352141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:17:59.352810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:17:59.353521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:17:59.395177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:59.397297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:59.399353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:59.402469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:59.403662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:59.406784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:59.526948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:17:59.547461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for user a288c513afd94adaa9f53f9f65dc9dd8 and project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:17:59.613196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:17:59.621679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:17:59.773227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-23d04606-12fb-4e8d-8f47-f2556f94e20a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.169162 Aug 31 19:17:59.781025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 21/49] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:17:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:17:59.801374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:59.805424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:17:59.830255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:59.831125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:59.835732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:17:59.836624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:17:59.838894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:17:59.841051 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:00.454400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:00.466608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-99144ffd-ae25-4688-8cff-4cec55d5ca7e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1238 microversion: 2.1 time: 0.687753 Aug 31 19:18:00.469353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 22/50] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:17:59 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1238 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:00.485045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:00.486202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:00.513006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:00.513540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:00.513987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:00.514712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:00.515172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:00.515598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:00.889764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:00.899756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eedd508c-420b-41e7-a1e4-807d4e1054c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1273 microversion: 2.1 time: 0.427748 Aug 31 19:18:00.916936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 23/51] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:00 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1273 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:00.916936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:00.916936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:00.925263 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:00.930313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:00.930896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:00.931769 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:00.932348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:00.932927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:01.585691 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:01.602124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:01.609879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:01.615155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cb50a467-f599-4f92-8150-549ef4ddb5fe tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1341 microversion: 2.20 time: 0.712166 Aug 31 19:18:01.618198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 24/52] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:00 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1341 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:01.650132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:01.656200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:01.685316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:01.686074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:01.693949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:01.695315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:01.697422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:01.699285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:02.716259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:02.750019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ada01169-7fb2-4a1d-8b14-27c836ab12d2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1289 microversion: 2.1 time: 1.110036 Aug 31 19:18:02.754681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 25/53] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:01 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1289 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:02.770286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:02.776010 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:02.816742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:02.820925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:02.823917 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:02.828113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:02.834106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:02.839059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:02.861784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:18:02.862319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:18:02.862916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:18:02.863884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:18:02.865306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:18:02.903525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:02.905999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:02.906812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:02.907707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:02.912853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:02.917325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:03.022772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for project a1342c2dbb1c41dca6061505220d9de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:18:03.053005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for user fd0f7f51482040d7a89df3f7502c2638 and project a1342c2dbb1c41dca6061505220d9de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:18:03.061472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:03.078251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-25bb10c8-b02a-4cf7-be89-d0e4a17e4fbb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1300 microversion: 2.1 time: 0.320076 Aug 31 19:18:03.084419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 26/54] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:02 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1300 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:03.104463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:03.106314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:18:03.107124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:03.127602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:18:03.133523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:03.134738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:03.138929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:03.139897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:03.142966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:03.144959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:03.374454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cc44e9c1-80ad-4a6f-bac7-6a514a3498ca tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.926239 Aug 31 19:18:03.375121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 29/55] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:17:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 4928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:18:03.392167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:03.408990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:03.452516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:03.453323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:03.454276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:03.455531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:03.456180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:03.456961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:03.706409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:03.764302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f150913e-07ba-4449-b113-4e9d59f66e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1273 microversion: 2.1 time: 0.678052 Aug 31 19:18:03.771481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 27/56] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:03 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1273 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:03.806970 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2b4f4b49-f154-4124-8457-92da4abcdaa2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:03.808583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2b4f4b49-f154-4124-8457-92da4abcdaa2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:04.042842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2b4f4b49-f154-4124-8457-92da4abcdaa2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:04.078776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2b4f4b49-f154-4124-8457-92da4abcdaa2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1222 microversion: 2.1 time: 0.299320 Aug 31 19:18:04.094960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 28/57] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:03 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1222 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:04.104664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:04.118086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:04.118902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:04.153977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:04.156729 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:04.159564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a897a354-39d2-412d-96ee-2648391a7ae0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1339 microversion: 2.20 time: 0.775275 Aug 31 19:18:04.160349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 30/58] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:03 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1339 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:04.171740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:04.173456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:04.186474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:04.187362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:04.191101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:04.191851 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:04.195113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:04.196096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:04.196780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:04.197677 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:04.200306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:04.200975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:04.202981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:04.205879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:04.868320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:04.883771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c9c1718c-33e9-42bb-b00f-320e431a1a20 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1289 microversion: 2.1 time: 0.787552 Aug 31 19:18:04.886770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 29/59] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:04 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1289 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:04.899572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:04.900433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:04.913896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:04.923109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:04.926948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:04.928306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:04.929771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:04.933647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:04.934497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:05.101624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:05.132686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f32678f-88dc-4cfc-8175-6e35b50117a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1300 microversion: 2.1 time: 0.970908 Aug 31 19:18:05.162036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 31/60] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:04 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1300 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:05.179487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:05.180404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:05.204202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:05.208087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:05.212329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:05.217049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:05.217579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:05.218443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:05.316091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:05.353337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-10418c47-ca75-42f1-80a8-8f32c44ce0b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1273 microversion: 2.1 time: 0.461495 Aug 31 19:18:05.357052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 30/61] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:04 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1273 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:05.378804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:05.389494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:05.396097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:05.396655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:05.397137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:05.428917 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:05.429514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:05.429967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:05.641689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:05.652831 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c9c9691f-75e7-4711-ae2a-4fa66f981430 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1226 microversion: 2.1 time: 0.489121 Aug 31 19:18:05.661116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 32/62] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:05 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1226 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:05.738174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:05.753026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:05.758311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:05.768274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fd746b99-4a7e-41c2-b09c-d84dfe7b9431 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1339 microversion: 2.20 time: 0.408311 Aug 31 19:18:05.771319 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 31/63] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:05 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1339 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:05.929077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:05.929916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:05.943071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:05.943774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:05.947480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:05.950262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:05.950958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:05.967059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:06.155675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:06.157600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:06.173987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:06.179141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:06.179910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:06.184344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:06.185958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:06.186929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.128296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:07.146371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-98efe567-e75d-40e1-814e-ca82c642cca5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1295 microversion: 2.1 time: 1.241126 Aug 31 19:18:07.150563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 33/64] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:05 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1295 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:07.170773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:07.171799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:07.205509 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:07.213670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:07.214773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.217720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:07.224277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:07.225672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.856755 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:07.870661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7f454f45-7628-4175-a4d5-61628c3282a4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 1.717706 Aug 31 19:18:07.874998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 32/65] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:06 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:07.891861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:07.894970 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:07.932172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:07.935975 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:07.936472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:07.936937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.937640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:07.948006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:07.948875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:07.956699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9610b1fb-879d-44e2-9f5a-f0185c4a3df6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.791663 Aug 31 19:18:07.958885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 34/66] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:07 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:07.986250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:07.992295 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:08.006596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.007828 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.009080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.011743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.014253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.014876 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.109725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:08.131085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-90e03a94-46b4-4266-ab25-b93b8b4c88c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.254382 Aug 31 19:18:08.148933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 33/67] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:07 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:08.172734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:08.173566 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:08.184656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.185218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.185591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.186318 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.186763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.187180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.316396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:08.328198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-06698b0e-b308-45ac-a837-5b486f5d8960 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1295 microversion: 2.1 time: 0.159115 Aug 31 19:18:08.328817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 34/68] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:08 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:08.365691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:08.379146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:08.382053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:08.383639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d0ee0eac-dbbf-4d48-a3fc-2579b2a3e2ee tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.406275 Aug 31 19:18:08.408289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 35/69] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:07 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:08.663320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7220888-b7b3-4d53-80fd-85596b3370cb", "tag": "96007021-e82b-4fbd-8d7a-9aca8d2f3dca"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:08.695360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.697009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.697629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.743176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Creating event network-changed:96007021-e82b-4fbd-8d7a-9aca8d2f3dca for instance d7220888-b7b3-4d53-80fd-85596b3370cb on hv-cinder-85221 Aug 31 19:18:08.743796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120707) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 19:18:08.744420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f716912f-05c5-405b-af2c-22e41d66328c req-49a13f6c-6975-40d5-9e3e-009fe27cdbde service nova] Acquired lock "compute-rpcapi-router" {{(pid=120707) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 19:18:08.745872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.746502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.747118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.748040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.749000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.749684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.773121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.compute.rpcapi [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 19:18:08.774170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] Releasing lock "compute-rpcapi-router" {{(pid=120707) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 19:18:08.801116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c7506b33-1bce-4e8f-ba2b-2668ae1cb94c None None] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324493 Aug 31 19:18:08.802674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 35/70] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:08.899592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:08.900534 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:08.908086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.908789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.909459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.910340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.911050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.911655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:08.988142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:08.990337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:08.998210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:08.998955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:08.999531 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.000383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.000995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.001745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.104219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.115391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5a175605-b9d5-4c19-adfc-854d3e2d91f7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.221834 Aug 31 19:18:09.129705 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 36/71] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:08 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:09.161659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:09.162538 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:09.175204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.176349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.176881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.177755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.178213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.178695 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.197965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.201704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:09.207875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3f0aaa54-df7e-40a4-8f27-b98810cd88ad tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.226935 Aug 31 19:18:09.230945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 36/72] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:08 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:09.262229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.278301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-45fa7017-c714-46a4-a787-832cd1c6d7e3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.122714 Aug 31 19:18:09.280079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 37/73] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:09 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:09.356064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:09.357110 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:09.369101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.370486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.371038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.372259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.372869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.373864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.427230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:09.427843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:09.437918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.438686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.439271 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.440116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:09.440834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:09.441411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:09.636690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.658891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a6db9c3f-b117-4015-9df5-35c8cdeabfcf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.308231 Aug 31 19:18:09.669245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 37/74] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:09 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:09.703746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.713742 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.719739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:09.725578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7b5a88b9-b444-40cd-b7a2-f2e9d55960b6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.302626 Aug 31 19:18:09.726399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 38/75] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:09 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:10.136298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:10.137809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:10.144447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.144996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.146230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.147374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.148131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.148723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.230929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:10.231627 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:10.238200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.238790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.244175 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.245230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.245890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.246523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.449959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:10.462058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8ad10a1c-f2d3-4634-9f74-6c3766316899 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.327381 Aug 31 19:18:10.468560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 38/76] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:10.475658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:10.476294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:10.482639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.483442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.484052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.485087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.485702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.486434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.559887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:10.581887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0ed01e9b-caf3-4d22-8db4-885dfec6eabd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.351607 Aug 31 19:18:10.583101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 39/77] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:10.632162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:10.643381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3603de4e-3dc7-48c0-b580-93af89521ef4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.172364 Aug 31 19:18:10.644137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 39/78] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:10.699853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:10.699853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:10.701248 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:10.720277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.722004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.722691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.725867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.726807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.727491 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.749151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:10.750288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:10.758780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.760703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.761435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:10.768773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:10.769699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:10.771274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.038318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.047809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.050817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-821d9034-ec91-4dfc-a1d6-371775968d91 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.358002 Aug 31 19:18:11.054980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 40/79] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:11.072768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.074416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.075735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-98d53198-df10-405f-8d15-880ebbb210be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.331300 Aug 31 19:18:11.076465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 40/80] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:11.501407 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:11.503778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:11.518174 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:11.519015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:11.523604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.524603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:11.527421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:11.529088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.606771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:11.608035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:11.619815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:11.620671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:11.621327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.622242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:11.623133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:11.625150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.839407 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.849487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f3536315-2d5b-49e1-ab8d-09aa9276f3c2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.360604 Aug 31 19:18:11.850813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 41/81] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:11 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:11.856132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:11.857155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:11.888728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:11.889986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:11.890480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:11.890913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.891607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:11.893395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:11.896303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:11.901449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-48343bcf-c064-40da-b758-24ab076608e6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.298354 Aug 31 19:18:11.905347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 41/82] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:11 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:12.023055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:12.031109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-229b4f26-3e64-475f-9330-470f7a2d6263 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.178925 Aug 31 19:18:12.031685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 42/83] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:11 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:12.072319 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:12.072957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:12.078735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.079212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.079648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.080327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.080872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.081296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.102699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:12.103321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:12.110399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.110891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.111336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.112033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.112493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.112990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.485899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:12.495195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b632a44-8873-4888-87b1-3677088e37e5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.427793 Aug 31 19:18:12.508865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 42/84] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:12 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:12.518367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:12.528275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:12.529771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:12.530890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e145aee2-dd50-4b31-8819-9121eef6a0fd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.434036 Aug 31 19:18:12.531426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 43/85] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:12 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:12.876242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:12.876928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:12.884762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.885369 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.886298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.887100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.887631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.888092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.933579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:12.939678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:12.962547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.963108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.963607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.964381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:12.964964 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:12.965442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:12.985604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:13.020086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:13.081928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=22 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:13.180493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.193746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-14d13b76-e306-49f0-b1da-b729216a08a8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.320783 Aug 31 19:18:13.195418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 43/86] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:12 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:13.203226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:13.204112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:13.212166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.212693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.213158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.213851 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.214295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.214712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.218932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.228184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-19769a13-5995-4395-9c7d-0635451664bb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.303199 Aug 31 19:18:13.229360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 44/87] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:12 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:13.285178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.294287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-868b9d27-026e-4844-86f0-db874f4024f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.096671 Aug 31 19:18:13.294916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 44/88] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:13 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:13.518163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:13.519191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:13.526769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.527409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.527848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.528696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.529150 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.529573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.555519 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:13.556130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:13.562525 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.563031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.563511 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.564252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:13.564732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:13.565169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:13.776667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.788912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.790011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a1db2edf-213b-4b40-b78d-473078f4e0f1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.275388 Aug 31 19:18:13.803712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.804237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 45/89] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:13 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:13.805438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:13.806627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc4e073f-57ce-4d41-b883-0fa88bb0be70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.255710 Aug 31 19:18:13.807185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 45/90] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:13 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:14.214486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:14.215901 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:14.223017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.224114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.224690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.225429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.226051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.226474 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.251593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:14.252350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:14.254221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=28 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:14.264996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.265858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.266528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.267614 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.268299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.268964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.437275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:14.449851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-073cd2cb-0bc0-4be4-98af-e2ff1d66e548 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.238990 Aug 31 19:18:14.464679 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 46/91] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:14 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:14.470347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:14.471236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:14.477753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.478234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.478660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.479386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.480054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.480170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:14.480650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.491961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ce6b38d-43b2-4a47-bde5-d81e62846c45 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.245128 Aug 31 19:18:14.493135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 46/92] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:14 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:14.558401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:14.566964 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c76e9d43-672c-4a01-aa58-27c3a7887202 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.102016 Aug 31 19:18:14.568841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 47/93] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:14 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:14.811427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:14.812126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:14.818305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.818876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.819402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.820171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.820756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.821180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.836128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:14.836919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:14.843164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.843783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.844252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:14.845228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:14.845561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:14.846045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.025194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.033624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a396b01d-bd79-4c84-b877-605a7a9d889e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.225990 Aug 31 19:18:15.034358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 47/94] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:14 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:15.050430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.066887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.070096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.071472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-540d80a1-876a-4faf-83ac-947feb53426a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.239785 Aug 31 19:18:15.072182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 48/95] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:14 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:15.476862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:15.477595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:15.483957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.484443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.484910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.485636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.486226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.486656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.514549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:15.515842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:15.522540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.523026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.523464 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.524170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.524651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.525076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.696302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.717266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d4a55eae-61c1-4da1-8675-e11010393064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.244329 Aug 31 19:18:15.717861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 48/96] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:15 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:15.722708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:15.723370 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:15.736717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.741256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.742114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.742674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.743492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:15.744049 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:15.744611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:15.748372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-971818f8-8cbd-49c7-8179-0de7ba35d312 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.237669 Aug 31 19:18:15.749087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 49/97] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:15 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:15.830383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:15.838803 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e69308f0-196d-426a-8896-154f6ba8cbc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.119932 Aug 31 19:18:15.852794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 49/98] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:15 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:16.056734 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:16.057363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:16.066108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.066926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.068146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.069536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.069659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.070222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.098197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:16.099179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:16.111140 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.111623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.112081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.113144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.113598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.116599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.288454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:16.296876 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-972baadb-887d-4420-9ebb-1fb97a0fed53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.245430 Aug 31 19:18:16.309758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 50/99] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:16 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:16.322424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:16.336905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:16.338620 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:16.339735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-da7813d7-53f4-4ab7-a38b-e4ba0d0d3030 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.246177 Aug 31 19:18:16.340277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 50/100] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:16 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:16.742184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:16.742810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:16.754304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.755895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.756559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.758615 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.759278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.760160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.777125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:16.778767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:16.794441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.795532 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.796170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:16.796973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:16.797486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:16.797979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.272289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:17.281737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-038ee945-763c-4b09-923a-95d8c9b96002 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.543252 Aug 31 19:18:17.282652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 51/101] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:16 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:17.291293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:17.292197 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:17.304246 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.305527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.306193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.307348 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.308337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.309459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.318661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:17.336740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6dc51cb2-55b7-4460-8495-b652b409d82f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.564675 Aug 31 19:18:17.351548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 51/102] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:16 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:17.360070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:17.360918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:17.370270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.371351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.372470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.373702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.374589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.375288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.473214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:17.494650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7bd71714-cb3f-41fb-90b0-c4d48f05ea39 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1274 microversion: 2.1 time: 0.208303 Aug 31 19:18:17.508125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 52/103] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:17 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:17.509844 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:17.510561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:17.523855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.524416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.525644 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:17.526538 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:17.527124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:17.527676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.215209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:18.229058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d9ba1358-8241-4772-a17d-4cd76c632605 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.874737 Aug 31 19:18:18.230958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 52/104] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:17 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:18.308242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:18.309200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:18.316167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.316893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.317551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.318468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.319112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.319886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.347926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:18.485805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:18.507765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:18.510342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:18.513453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b182be1d-925b-419a-ad2d-0466e0784c3c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 1.015154 Aug 31 19:18:18.515976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 53/105] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:17 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:18.525052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:18.526442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:18.572219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.577713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.578789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.580691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.582346 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.585491 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.759128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=8 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:18.883973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:18.917682 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2bd6b3e-7f9b-465e-a8d1-da0ca1412594 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.612771 Aug 31 19:18:18.921055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 53/106] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:18 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:18.939743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:18.943910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:18.960437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.973766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.974244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:18.975010 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:18.975470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:18.975887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.416998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:19.433008 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c9cb2068-83b0-4aa3-89c5-3c24888ff71e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1280 microversion: 2.1 time: 0.509259 Aug 31 19:18:19.436677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 54/107] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:18 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1280 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:19.452054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:19.463405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-562e2c83-5cb3-4e34-9bef-aec78d8d6d0e req-1a5ac327-1e9d-4319-98bd-5ec0d5ebdf86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e955cd6-de98-48e5-90af-020d4952bc40", "tag": "28578596-0058-4fd6-b56b-d8ccf5626348"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:19.467680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b5ef92ab-5450-4ea8-b1f1-b855c38594d0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.947752 Aug 31 19:18:19.492890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 54/108] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:18 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:19.493889 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-562e2c83-5cb3-4e34-9bef-aec78d8d6d0e req-1a5ac327-1e9d-4319-98bd-5ec0d5ebdf86 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.495803 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-562e2c83-5cb3-4e34-9bef-aec78d8d6d0e req-1a5ac327-1e9d-4319-98bd-5ec0d5ebdf86 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.497408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-562e2c83-5cb3-4e34-9bef-aec78d8d6d0e req-1a5ac327-1e9d-4319-98bd-5ec0d5ebdf86 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.510584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:19.511924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:19.530283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-562e2c83-5cb3-4e34-9bef-aec78d8d6d0e req-1a5ac327-1e9d-4319-98bd-5ec0d5ebdf86 service nova] Creating event network-changed:28578596-0058-4fd6-b56b-d8ccf5626348 for instance 4e955cd6-de98-48e5-90af-020d4952bc40 on hv-cinder-85221 Aug 31 19:18:19.538217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.540973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.542344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.544218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-562e2c83-5cb3-4e34-9bef-aec78d8d6d0e req-1a5ac327-1e9d-4319-98bd-5ec0d5ebdf86 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103722 Aug 31 19:18:19.544971 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.545803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.546244 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.547282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 55/109] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:19.561927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:19.565469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:19.586057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.587692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.588130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:19.600831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:19.600831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:19.601442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.230819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.235606 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.242443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-19dabf27-5f95-4549-bae1-b11ac4d71d54 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.747423 Aug 31 19:18:20.243578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 55/110] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:19 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:20.261392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.263114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.264709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-73baee1a-3c8b-4042-b3c8-c6dca4f3069c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.713174 Aug 31 19:18:20.265696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 56/111] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:19 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:20.273284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:20.274484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:20.283654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.285942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.290135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.291941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.293278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.294211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.341206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9952e4e3-5b71-4512-8bc4-cd0339fc24c7", "tag": "9b68f3b2-a4ed-4d2d-8371-adf91acb6cac"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:20.362439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.365868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.366327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.393233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Creating event network-changed:9b68f3b2-a4ed-4d2d-8371-adf91acb6cac for instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 on hv-cinder-85221 Aug 31 19:18:20.394538 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 19:18:20.394953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2bf1488c-6dfb-41c0-956a-17e4469a156c req-133e30d1-ac7b-4da5-bc3a-8d113df87608 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 19:18:20.397298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.397975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.398563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.399786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.400473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.400916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.418362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.compute.rpcapi [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 19:18:20.422022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] Releasing lock "compute-rpcapi-router" {{(pid=120706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 19:18:20.442721 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5eccb659-a002-4a4f-badc-e22590740389 None None] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196676 Aug 31 19:18:20.444096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 56/112] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:20.459217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:20.460241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:20.466991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.467573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.468091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.468919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.469670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.470121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.628353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.646596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7906383e-e3e2-489f-840e-f205e781e0e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1280 microversion: 2.1 time: 0.191452 Aug 31 19:18:20.647340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 57/113] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:20 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:20.653580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:20.654413 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:20.662673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.665042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.665718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.671533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:20.672492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:20.673016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:20.902021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:20.910929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4611cd93-82d5-47ca-a8f7-fe0a9254dc4a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.643384 Aug 31 19:18:20.924594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 57/114] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:20 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:21.072750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.082598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1add268e-11a8-445c-887c-858d654383fb tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.432707 Aug 31 19:18:21.092638 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 58/115] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:20 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:21.263974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:21.264696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:21.271589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.272171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.272777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.273487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.273940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.274358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.293092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:21.293754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:21.300838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.302591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.303260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.304183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.304891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.305523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.528953 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.551302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.560153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.561669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.562766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2d261162-a28a-4bda-b4f3-0e14093cab4c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.274311 Aug 31 19:18:21.564300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8f398cba-b844-4f91-9274-57cc2cac2bdc tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.304827 Aug 31 19:18:21.565187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 58/116] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:21 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:21.565871 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 59/117] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:21 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:21.634981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-2219c857-9800-4ac1-b808-947e8026ef35 req-5222ef13-494f-458b-a8af-db20ab70e876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:21.646336 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2219c857-9800-4ac1-b808-947e8026ef35 req-5222ef13-494f-458b-a8af-db20ab70e876 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.647197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2219c857-9800-4ac1-b808-947e8026ef35 req-5222ef13-494f-458b-a8af-db20ab70e876 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.647812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2219c857-9800-4ac1-b808-947e8026ef35 req-5222ef13-494f-458b-a8af-db20ab70e876 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.660398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-2219c857-9800-4ac1-b808-947e8026ef35 req-5222ef13-494f-458b-a8af-db20ab70e876 service nova] Creating event network-changed:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:18:21.669498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-2219c857-9800-4ac1-b808-947e8026ef35 req-5222ef13-494f-458b-a8af-db20ab70e876 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038433 Aug 31 19:18:21.670695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 59/118] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:21.673131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:21.673657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:21.681015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.681569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.682327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.683187 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.683776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.684162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.855398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:21.866762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2eeebdc1-c3eb-43b7-9386-99bdf963f7d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.201753 Aug 31 19:18:21.868401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 60/119] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:21 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:21.937317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:21.938138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:21.944716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.945396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.945834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:21.946530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:21.947003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:21.947502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.111365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:22.112136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:22.118939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.119438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.122241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.122994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.123463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.125483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.169513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:22.317128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:22.335314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2eb681f2-70d2-41c7-89b0-1d21b6a2a19e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.402409 Aug 31 19:18:22.336378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 60/120] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:21 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:22.463138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:22.477633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6b9f2c66-6b90-43aa-b5f5-cb76d66aa779 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.370006 Aug 31 19:18:22.478523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 61/121] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:22 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:22.564270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-d720cb8d-6503-469a-8187-2c008b6ac0e8 req-1b178647-7b1f-4168-a615-637329e539ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b6f9fc-d26a-4175-8aa9-c450f6d605d8", "tag": "a028882f-9afc-4b60-9bcc-546d9758006b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:22.581833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-d720cb8d-6503-469a-8187-2c008b6ac0e8 req-1b178647-7b1f-4168-a615-637329e539ff service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.582308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-d720cb8d-6503-469a-8187-2c008b6ac0e8 req-1b178647-7b1f-4168-a615-637329e539ff service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.586628 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-d720cb8d-6503-469a-8187-2c008b6ac0e8 req-1b178647-7b1f-4168-a615-637329e539ff service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.589389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:22.590098 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:22.606120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-d720cb8d-6503-469a-8187-2c008b6ac0e8 req-1b178647-7b1f-4168-a615-637329e539ff service nova] Creating event network-changed:a028882f-9afc-4b60-9bcc-546d9758006b for instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 on hv-cinder-85221 Aug 31 19:18:22.607168 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.607984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.609788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.613236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.614272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.616758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.618494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-d720cb8d-6503-469a-8187-2c008b6ac0e8 req-1b178647-7b1f-4168-a615-637329e539ff service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057698 Aug 31 19:18:22.619096 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 61/122] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:22.635774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:22.641596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:22.653858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.654627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.655233 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.655945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:22.656396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:22.656835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:22.977029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:22.982598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:22.992064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d351c3b7-7825-4d03-a7cb-ccb409bc03d6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.366997 Aug 31 19:18:22.999281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 62/123] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:22 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:23.001133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:23.001985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:23.002398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:23.004533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:23.007809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6aa8782f-5311-4f72-8ea0-cb11fb9eb9e6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.426024 Aug 31 19:18:23.008892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 62/124] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:22 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:23.029706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:23.030613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:23.031241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:23.032853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:23.034145 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:23.034763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:23.276920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:23.287873 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-40229fce-3b34-49c8-ad42-3e9afc924b1f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.293326 Aug 31 19:18:23.290608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 63/125] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:22 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:23.357044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:23.357659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:23.365299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:23.366011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:23.366444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:23.367767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:23.368454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:23.368955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:23.502494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:23.505010 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:23.515077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:23.515790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:23.516413 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:23.517328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:23.517972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:23.519143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:23.533159 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:23.547259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7292913-a565-43ef-aa08-1af2e27e3778 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.194383 Aug 31 19:18:23.547933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 63/126] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:23 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:23.690251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:23.699386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-36edbbe9-0031-41f3-a159-3a2ae5b9b37b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.203935 Aug 31 19:18:23.699967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 64/127] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:23 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:24.015752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:24.016365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:24.032878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:24.033772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:24.041400 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.042180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.042990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.046381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.047893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.048412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.048849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.049041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.052987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.054551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.057376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.059058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.392100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.406556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a5a5d52f-9f5d-40c5-838c-352be956cdb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.395726 Aug 31 19:18:24.407420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 64/128] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:24 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:24.416162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:24.416949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:24.423423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.423966 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.424457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.425227 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.425735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.426298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.431676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.440480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.442014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.443127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f64f3b77-162e-4ad1-9c8c-ad14e3a1292b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.414630 Aug 31 19:18:24.457315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 65/129] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:24 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:24.572777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:24.573872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:24.585412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.585957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.586385 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.587206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.587885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.588314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.635583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.647627 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-83977106-7696-45d5-92b8-d4bd0f51ce86 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.238763 Aug 31 19:18:24.648382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 65/130] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:24 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:24.653392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-3e3f1ae5-e9f1-466a-acce-cce074ac09e7 req-fe4a8c8c-351c-4c2c-8b72-74660390c877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a", "tag": "241c7767-5424-40a4-b0ce-0e9e433d2649"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:24.664352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3e3f1ae5-e9f1-466a-acce-cce074ac09e7 req-fe4a8c8c-351c-4c2c-8b72-74660390c877 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.664853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3e3f1ae5-e9f1-466a-acce-cce074ac09e7 req-fe4a8c8c-351c-4c2c-8b72-74660390c877 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.665529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3e3f1ae5-e9f1-466a-acce-cce074ac09e7 req-fe4a8c8c-351c-4c2c-8b72-74660390c877 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.687251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-3e3f1ae5-e9f1-466a-acce-cce074ac09e7 req-fe4a8c8c-351c-4c2c-8b72-74660390c877 service nova] Creating event network-changed:241c7767-5424-40a4-b0ce-0e9e433d2649 for instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a on hv-cinder-85221 Aug 31 19:18:24.693824 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-3e3f1ae5-e9f1-466a-acce-cce074ac09e7 req-fe4a8c8c-351c-4c2c-8b72-74660390c877 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043952 Aug 31 19:18:24.694609 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 66/131] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:24.725294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:24.725999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:24.737084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.737084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.737369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.739298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:24.740489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:24.742544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:24.921121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.929307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8fac5be9-5f6b-4279-9f37-ac925bb13f24 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.361560 Aug 31 19:18:24.929972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 66/132] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:24 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:24.978735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:24.986699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-59264599-3ad1-4155-ba1a-d0db468d0702 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.268079 Aug 31 19:18:24.987484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 67/133] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:24 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:25.429241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:25.430512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:25.439898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.443230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.443853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.449894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.453014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.453506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.466123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:25.467654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:25.480777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.481269 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.481710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.482409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.482869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.483290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.758381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:25.759328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:25.768482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-712e8716-90ba-4ef0-884c-8a1332d7e758 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.344090 Aug 31 19:18:25.775972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:25.778326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:25.779704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-154547d1-d828-4bcb-80b3-fc8f36ced10c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.317855 Aug 31 19:18:25.782372 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 67/134] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:25 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:25.796728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 68/135] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:25 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:25.800884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:25.801579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:25.807557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.808039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.808474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.809265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.809718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.810141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.954362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:25.955197 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:25.962355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.963432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.964205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:25.965454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:25.966358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:25.967148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:26.026060 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:26.051190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6b700a9d-194a-4805-a0f7-645893bd11ef tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.263466 Aug 31 19:18:26.055883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 68/136] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:25 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:26.063703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:26.072561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:26.086472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:26.087158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:26.087850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:26.089273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:26.089935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:26.090474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:26.751000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:26.775493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8e25a4fc-5314-4a9c-a40a-2d107d54f0ef tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.827938 Aug 31 19:18:26.782760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 69/137] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:25 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:26.790444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:26.791049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:26.811332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:26.812458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:26.814916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:26.827314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:26.829261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:26.831597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:26.924088 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:26.933242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c594a106-aa90-402d-bd6c-a022d795b760 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.875962 Aug 31 19:18:26.933823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 69/138] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:26 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:26.964157 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:26.964856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:26.977101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:26.977899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:26.978479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:26.979326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:26.979932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:26.980490 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:27.340830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:27.349631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d11ff2b-3dad-4fe2-93bf-bfc547ec69c5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.563988 Aug 31 19:18:27.350550 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 70/139] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:26 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:27.355816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:27.356644 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:27.363569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:27.365316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:27.365769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:27.366482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:27.366938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:27.367423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:27.377579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:27.386687 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:27.388061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:27.389409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-07dc3662-9089-4845-bad3-7aae7bf40153 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.433461 Aug 31 19:18:27.389954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 70/140] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:26 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:27.577025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:27.586920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-55db0ad0-40da-4809-9a0d-e9b119af68d0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.235292 Aug 31 19:18:27.587576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 71/141] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:27 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:27.807386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:27.807986 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:27.814004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:27.814476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:27.814902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:27.815579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:27.816021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:27.816429 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:27.952725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:27.957296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:27.959112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:27.961716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-993d918a-0e5c-4f9c-9317-59e23d74a3ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.157732 Aug 31 19:18:27.961985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 71/142] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:27 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:27.967713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:27.968199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:27.968664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:27.969409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:27.969843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:27.970263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.111604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:28.119931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-44738509-bdbd-4118-a6c1-af5d42a22c27 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.166323 Aug 31 19:18:28.120505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 72/143] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:27 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:28.377912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:28.379150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:28.386322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.386995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:28.387428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.388316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.388948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:28.389372 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.398070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:28.413243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:28.413986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:28.420300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.421058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:28.421740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.422647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.423247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:28.423765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.627378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:28.637303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:28.639606 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:28.641165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a867cb3f-263d-43e6-9bef-a67650a34a73 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.233299 Aug 31 19:18:28.641931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 73/144] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:28 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:28.648256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:28.649174 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:28.655651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.656515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:28.657370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.659235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.659810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:28.661191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:28.671039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:28.682982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-85ee290b-5b27-4ffa-8ed8-20df35781c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.312220 Aug 31 19:18:28.686681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 72/145] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:28 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:28.983002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:28.985257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:28.996398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:28.997987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.000128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.001462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.003790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.006182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.019493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:29.033264 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b72951ef-efb0-486b-b4fb-303dd386a576 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.389758 Aug 31 19:18:29.035394 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 74/146] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:28 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:29.145540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:29.146080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:29.154753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.165974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.167942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.169903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.170529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.171107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.401893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:29.425398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-70b436ba-728b-484a-b044-3a627d4aa15f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.446107 Aug 31 19:18:29.431641 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:29.435240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 73/147] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:28 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:29.439930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-65fea21a-b71e-406b-ac7a-e0c9408204d7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.299061 Aug 31 19:18:29.443608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 75/148] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:29 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:29.542631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-a924911f-494c-4d74-bc75-618a67c8cd5f req-dce69f86-c236-495d-903b-593a4a37e123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "name": "network-vif-plugged", "status": "completed", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:29.558653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a924911f-494c-4d74-bc75-618a67c8cd5f req-dce69f86-c236-495d-903b-593a4a37e123 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.559132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a924911f-494c-4d74-bc75-618a67c8cd5f req-dce69f86-c236-495d-903b-593a4a37e123 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.559546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a924911f-494c-4d74-bc75-618a67c8cd5f req-dce69f86-c236-495d-903b-593a4a37e123 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.589569 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-a924911f-494c-4d74-bc75-618a67c8cd5f req-dce69f86-c236-495d-903b-593a4a37e123 service nova] Creating event network-vif-plugged:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:18:29.597575 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-a924911f-494c-4d74-bc75-618a67c8cd5f req-dce69f86-c236-495d-903b-593a4a37e123 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156389 Aug 31 19:18:29.598995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 74/149] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:29.667830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:29.668429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:29.680409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.680941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.681419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.682364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.682954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.683080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.711922 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:29.712991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:29.727041 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.727526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.727947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:29.728852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:29.730195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:29.731257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.032885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.041883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.043542 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.044769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-42ea475b-5616-4ae1-a6ff-580cfa6b6505 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.380895 Aug 31 19:18:30.060655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 76/150] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:29 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:30.065533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:30.066454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:30.073563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.084361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7e69a3ae-c958-41f1-961e-a6c2f66f6a2c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.377390 Aug 31 19:18:30.085631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:30.086108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:30.086536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.087226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:30.087968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 75/151] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:29 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:30.089141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:30.089346 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.294696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.303709 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-753a02d8-564b-4b45-b386-eae211a49b42 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.241861 Aug 31 19:18:30.308673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 77/152] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:30 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:30.458958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:30.458958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:30.464211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:30.464357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:30.464809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:30.465425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.465870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:30.466269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:30.466710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:30.467123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.468319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:30.476527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:30.483793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:30.485374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.489867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:30.490177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:30.490855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:30.700507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.703851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:30.708072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:30.718772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-96614f51-1356-4537-876e-d25819a829e6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.265828 Aug 31 19:18:30.719377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 76/153] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:30 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:30.721925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f8fb2efb-111b-4516-a82f-c4c1f172deb0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.261501 Aug 31 19:18:30.722814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 78/154] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:30 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:31.068624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.069510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:31.076840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.077529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.077740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.078440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.078893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.079308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.112170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.112850 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:31.127493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.128213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.128822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.130796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.131631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.133362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.419897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:31.428087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-098f5811-090f-4f0d-8279-085c329e08f6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.320887 Aug 31 19:18:31.429049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 79/155] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:31.431846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:31.433595 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.434360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:31.440415 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.441150 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.442308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.443509 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.443715 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:31.444310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.444756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.446324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:31.447963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bc53b6c4-ef9c-41fa-a807-ae70b2d7d5ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.384257 Aug 31 19:18:31.461483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 77/156] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:31.603795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:31.613160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7e572bb-fbfe-452e-8562-392f33f378ab tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.182936 Aug 31 19:18:31.614449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 80/157] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:31.630561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e955cd6-de98-48e5-90af-020d4952bc40", "name": "network-vif-plugged", "status": "completed", "tag": "28578596-0058-4fd6-b56b-d8ccf5626348"}, {"server_uuid": "d7220888-b7b3-4d53-80fd-85596b3370cb", "name": "network-vif-plugged", "status": "completed", "tag": "96007021-e82b-4fbd-8d7a-9aca8d2f3dca"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:31.641918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.642527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.643155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.665092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] Creating event network-vif-plugged:28578596-0058-4fd6-b56b-d8ccf5626348 for instance 4e955cd6-de98-48e5-90af-020d4952bc40 on hv-cinder-85221 Aug 31 19:18:31.666098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] Creating event network-vif-plugged:96007021-e82b-4fbd-8d7a-9aca8d2f3dca for instance d7220888-b7b3-4d53-80fd-85596b3370cb on hv-cinder-85221 Aug 31 19:18:31.673322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-80811097-8281-486e-9d78-88e38a4ae899 req-f38f48c9-3e76-4d15-aa6d-d51f3c65a821 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046955 Aug 31 19:18:31.674501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 78/158] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:31.740717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.741643 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:31.747597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.748042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.748288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:31.749164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.749755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.750789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.751401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.751990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.758984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.759177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.759567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.760972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:31.761915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:31.761915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:31.999528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.012367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f40488c1-d7b3-4afc-bb10-7776ee4103bd tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.269240 Aug 31 19:18:32.012997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 79/159] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:32.021958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.036908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd88eb34-f6b8-4766-954a-8fdedf8cc83a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.299154 Aug 31 19:18:32.037607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 81/160] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:32.451225 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:32.451830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:32.455046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:32.460100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:32.460541 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:32.461174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:32.462185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:32.462786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:32.464236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:32.476915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:32.477573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:32.492867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:32.493380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:32.494174 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:32.494576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:32.494975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:32.495404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:32.712913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.727304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-817d5a0d-a027-48f4-8a58-c16bbc9f0bb0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.279821 Aug 31 19:18:32.727877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 80/161] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:32 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:32.744207 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:32.745631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:32.753134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:32.754012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:32.755376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:32.756467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:32.757185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:32.757818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:32.818875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.829078 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.830622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.831895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5055b466-0b4a-476c-bd11-726d7e04aa2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.362711 Aug 31 19:18:32.844604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 82/162] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:32 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:32.960484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:32.981877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e64fc9f1-e911-446d-8591-4ce51cac8d47 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.249831 Aug 31 19:18:32.982432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 81/163] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:32 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:33.033857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.034822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:33.045666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.047041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.048222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.049344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.050070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.058537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.059142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:33.065052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.073466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.074282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.076040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.079364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.082001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.087660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.668820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:33.681066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-adf7def5-3744-488c-98d0-e83b38166e2b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.625121 Aug 31 19:18:33.682876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 82/164] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:33.701131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:33.710903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b641248d-5193-47fb-8287-5fde861ef957 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.680872 Aug 31 19:18:33.727355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 83/165] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:33.751915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.752559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:33.788380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.789577 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.790074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.790851 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.791308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.791733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.870656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.872026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:33.878211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.878981 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.880223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:33.881138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:33.881769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:33.882366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:34.064009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:34.074127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c700591d-1ae8-4291-980c-94be836e3964 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.325865 Aug 31 19:18:34.074906 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 83/166] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:34.080841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:34.085028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:34.094701 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:34.095179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:34.095776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:34.097006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:34.097599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:34.098204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:34.117043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:34.126501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:34.129971 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:34.131518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f1326397-8924-4e81-a89d-37853b786a21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.264830 Aug 31 19:18:34.132683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 84/167] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:34.251633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:34.260914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9c9f63ff-9f42-480a-aa52-42eb4e6b7f55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.183546 Aug 31 19:18:34.261495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 84/168] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:34 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:34.702553 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:34.703155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:34.716032 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:34.716737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:34.717338 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:34.725140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:34.725624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:34.726047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:34.733028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:34.733636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:34.749589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:34.750175 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:34.750622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:34.751360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:34.751808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:34.752228 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.056072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.064948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-583f4810-d791-4412-96b9-7aa556941663 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.337104 Aug 31 19:18:35.069695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 85/169] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:34 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:35.095801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.096463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:35.100252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.106809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:35.107293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:35.107721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.108473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:35.109006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:35.109379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.111585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9fe22331-c960-49d9-b258-3d03defda1d3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.412746 Aug 31 19:18:35.112734 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 85/170] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:34 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:35.154473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.155155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:35.168204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:35.170803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:35.173922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.178161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:35.178934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:35.179504 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.502081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.511997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.521782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.523114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-49edd683-1a42-444c-a41e-7a435bfe4996 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.372882 Aug 31 19:18:35.524598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 86/171] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:35 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:18:35.532632 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.533383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:35.544972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.546982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:35.547719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:35.548195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.549224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:35.549777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:35.551063 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:35.559037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c8815560-1790-460a-9113-2b909f45bee2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.467509 Aug 31 19:18:35.559910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 86/172] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:35 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:35.721796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:35.729843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-917e6ced-df65-47a5-95e9-8d1aa1faea59 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.200822 Aug 31 19:18:35.732109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 87/173] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:35 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:36.092539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.093814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:36.101258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.101965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.102543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.103534 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.104768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.136308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.137864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:36.145914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.146605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.147202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.148113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.148889 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.149503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.302168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:36.311179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f331688e-3b3c-47b4-a85b-c4e9c5634b78 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.223706 Aug 31 19:18:36.311966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 87/174] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:36.368832 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:36.377775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-83fb64bd-dcc5-4913-8020-1ecbe731c66a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.247195 Aug 31 19:18:36.382081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 88/175] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:36.552068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.553417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:36.578022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.578517 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.578956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.579665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.580118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.580538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.581817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.583041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:36.598577 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.599124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.599564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:36.600303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:36.600804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:36.603689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:37.204997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:37.207159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:37.213620 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d381941b-2d79-459f-a213-01e66508e6bb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.636149 Aug 31 19:18:37.221399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:37.223086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:37.224122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bb469410-6bd5-449b-b5e1-5be580985507 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.677028 Aug 31 19:18:37.227447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 89/176] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:37.234618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 88/177] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:37.242506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-4f6174f5-9253-4ca1-80b8-08ce0bdcbf5c req-8d4200d4-3280-4e15-90ea-3608e70bfc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9952e4e3-5b71-4512-8bc4-cd0339fc24c7", "name": "network-vif-plugged", "status": "completed", "tag": "9b68f3b2-a4ed-4d2d-8371-adf91acb6cac"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:37.247027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:37.251322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:37.253778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:37.258270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4f6174f5-9253-4ca1-80b8-08ce0bdcbf5c req-8d4200d4-3280-4e15-90ea-3608e70bfc7d service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:37.258745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4f6174f5-9253-4ca1-80b8-08ce0bdcbf5c req-8d4200d4-3280-4e15-90ea-3608e70bfc7d service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:37.259199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-4f6174f5-9253-4ca1-80b8-08ce0bdcbf5c req-8d4200d4-3280-4e15-90ea-3608e70bfc7d service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:37.264822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:37.265605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:37.266288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:37.267295 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:37.268444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:37.284655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:37.289396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-4f6174f5-9253-4ca1-80b8-08ce0bdcbf5c req-8d4200d4-3280-4e15-90ea-3608e70bfc7d service nova] Creating event network-vif-plugged:9b68f3b2-a4ed-4d2d-8371-adf91acb6cac for instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 on hv-cinder-85221 Aug 31 19:18:37.302847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-4f6174f5-9253-4ca1-80b8-08ce0bdcbf5c req-8d4200d4-3280-4e15-90ea-3608e70bfc7d service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069325 Aug 31 19:18:37.303530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 89/178] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:37.336493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:37.337400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:37.346980 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:37.353412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:37.354065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:37.355790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:37.356360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:37.356904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.294851 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:38.303283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:38.305820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-003e7283-99ba-4da8-a0be-055f318c32f3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.973949 Aug 31 19:18:38.312592 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 90/179] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:37 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:38.322377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:38.325150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:38.342846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:38.345135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:38.346169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.347154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:38.350165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:38.351850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.389872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:38.405097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c5a77bd4-4ba8-4f9e-ad7c-f984caf9bb49 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 1.174452 Aug 31 19:18:38.408971 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 90/180] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:37 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:38.420514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:38.421494 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:38.431279 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:38.432054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:38.432888 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.434091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:38.435018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:38.435594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.642558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:38.659989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-78d6b069-16dc-47bf-ae25-312e56aa64f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.345747 Aug 31 19:18:38.661066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 91/181] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:38 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:38.670987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:38.671600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:38.679117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:38.679841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:38.680450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.681365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:38.682147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:38.682721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:38.873097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:38.881459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-53159e86-2a77-4e48-b7e6-cb7c6c4070f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.471171 Aug 31 19:18:38.884232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 91/182] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:38 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:39.017298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:39.027495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:39.031792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:39.033613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9f733150-b2a2-4847-a24b-8f71b8ba96d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.371343 Aug 31 19:18:39.034256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 92/183] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:38 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:39.340059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:39.340914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:39.355912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.356667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.357344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.358330 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.358946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.359515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.438056 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:39.440929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:39.451322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.452018 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.452695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.454349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.455094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.455834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.872069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:39.886796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fa6dffd8-63c7-494c-af69-ab45c27fa540 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.458754 Aug 31 19:18:39.890995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 93/184] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:39 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:39.898679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-56ca441c-8324-4945-87c7-0d3648130c62 req-174620d5-0d75-4f1a-8773-5a6c4cc0d429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b6f9fc-d26a-4175-8aa9-c450f6d605d8", "name": "network-vif-plugged", "status": "completed", "tag": "a028882f-9afc-4b60-9bcc-546d9758006b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:39.918631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:39.943116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-56ca441c-8324-4945-87c7-0d3648130c62 req-174620d5-0d75-4f1a-8773-5a6c4cc0d429 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.943116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-56ca441c-8324-4945-87c7-0d3648130c62 req-174620d5-0d75-4f1a-8773-5a6c4cc0d429 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.943116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-56ca441c-8324-4945-87c7-0d3648130c62 req-174620d5-0d75-4f1a-8773-5a6c4cc0d429 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.944757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-36d279bc-4169-4ad8-a4e6-588b2da22cbc tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.608295 Aug 31 19:18:39.947909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 92/185] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:39 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:39.950701 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-56ca441c-8324-4945-87c7-0d3648130c62 req-174620d5-0d75-4f1a-8773-5a6c4cc0d429 service nova] Creating event network-vif-plugged:a028882f-9afc-4b60-9bcc-546d9758006b for instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 on hv-cinder-85221 Aug 31 19:18:39.958928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:39.961900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:39.968497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-56ca441c-8324-4945-87c7-0d3648130c62 req-174620d5-0d75-4f1a-8773-5a6c4cc0d429 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073841 Aug 31 19:18:39.969363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 94/186] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:39.975881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:39.979442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.980084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.980654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.981522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.983193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:39.990295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.990978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.991563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.992416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:39.993032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.993629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:39.995372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:39.995974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:40.224726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:40.231493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:40.239408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-74a48549-8928-44bb-998c-924a76011e1f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.289207 Aug 31 19:18:40.240394 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 93/187] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:39 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:40.245887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a24ccf68-9701-48d4-924f-3846c2a304c9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.274152 Aug 31 19:18:40.246710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 95/188] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:39 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:40.262368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:40.262368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:40.269352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:40.269917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:40.270501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:40.271262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:40.271709 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:40.272152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:40.429912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:40.439741 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:40.442489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:40.443811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-61ad4ecc-541c-4953-a76d-9674d8cc871c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.201821 Aug 31 19:18:40.444529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 94/189] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:40 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:40.913639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:40.915177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:40.923783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:40.924981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:40.926355 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:40.927454 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:40.928230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:40.928866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:40.976474 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:40.979637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:40.993089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:40.996048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.000181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.001116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.003740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.005185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.052848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:41.185625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:41.201919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5e40236e-70e3-4884-9ddd-e3109e3ed39f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.293641 Aug 31 19:18:41.205092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 96/190] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:40 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:41.261952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:41.262815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:41.277577 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.278127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.279006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.279739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.280211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.285302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.393074 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:41.406826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d662e73d-46e3-441b-93b3-f4f2f0b237b1 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.436724 Aug 31 19:18:41.408314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 95/191] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:40 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:41.436020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:41.437822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:41.473814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.474681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.476109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.479598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.480299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.483299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.557681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:41.573058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-74ec1fa0-376e-4413-8a86-84f1c895ac5a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1366 microversion: 2.1 time: 0.315177 Aug 31 19:18:41.574235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 97/192] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:41 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:41.579065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:41.585576 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:41.594422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.598889 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.602133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.605199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:41.607030 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:41.609469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:41.872922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:41.887956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-73f4673e-9ed3-44e3-b78d-9ab32ec96c0f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1363 microversion: 2.1 time: 0.474459 Aug 31 19:18:41.891017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 96/193] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:41 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:42.055745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:42.084517 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:42.093660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:42.096663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b5f46c3c-2969-4a02-a802-56c6708b9993 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1405 microversion: 2.20 time: 0.521216 Aug 31 19:18:42.111599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 98/194] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:41 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:42.230860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:42.231589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:42.243519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.244520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.245314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:42.246444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.247150 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.247835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:42.299314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-9b738508-116a-424a-bb8f-e78a17f8e1e6 req-994a9c63-c2fd-44cd-b9f2-864321d7e1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a", "name": "network-vif-plugged", "status": "completed", "tag": "241c7767-5424-40a4-b0ce-0e9e433d2649"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:42.329566 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9b738508-116a-424a-bb8f-e78a17f8e1e6 req-994a9c63-c2fd-44cd-b9f2-864321d7e1b5 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.330069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9b738508-116a-424a-bb8f-e78a17f8e1e6 req-994a9c63-c2fd-44cd-b9f2-864321d7e1b5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.330449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-9b738508-116a-424a-bb8f-e78a17f8e1e6 req-994a9c63-c2fd-44cd-b9f2-864321d7e1b5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:42.361215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-9b738508-116a-424a-bb8f-e78a17f8e1e6 req-994a9c63-c2fd-44cd-b9f2-864321d7e1b5 service nova] Creating event network-vif-plugged:241c7767-5424-40a4-b0ce-0e9e433d2649 for instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a on hv-cinder-85221 Aug 31 19:18:42.386000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-9b738508-116a-424a-bb8f-e78a17f8e1e6 req-994a9c63-c2fd-44cd-b9f2-864321d7e1b5 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080571 Aug 31 19:18:42.386798 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 99/195] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:42.429688 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:42.430522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:42.436926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.437660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.438434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:42.439290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.439882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.440443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:42.576425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:42.603646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fc8cb11c-8377-4f9f-af26-21ffe709ad13 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.377775 Aug 31 19:18:42.621001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 97/196] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:42 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:42.626189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:42.650575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:42.669518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.670410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.671418 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:42.673033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:42.673887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:42.674814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:43.103217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:43.118782 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ba0c08bf-d9d6-4c81-86f3-8d178c41a8d2 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.693182 Aug 31 19:18:43.119796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 100/197] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:42 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:43.126014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:43.128810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:43.139165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:43.139786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:43.140439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:43.141476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:43.142290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:43.146087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:43.405636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:43.419278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c70c9e6f-2928-4269-a2ee-688c7de021b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1555 microversion: 2.1 time: 0.796722 Aug 31 19:18:43.427831 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 98/198] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:42 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1555 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:43.446160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:43.446800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:43.480750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:43.481743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:43.485239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:43.487508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:43.489281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:43.489841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:44.085627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:44.104036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e5e01119-9dd4-49e2-ac5b-8ec323f22517 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1548 microversion: 2.1 time: 0.982839 Aug 31 19:18:44.117487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 101/199] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:43 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1548 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:44.126978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:44.127639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:44.167430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:44.168293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:44.168977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:44.169941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:44.170640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:44.171293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:44.466060 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-247ea8bf-5163-4fc1-8673-9dc0c5e9b7b7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.347351 Aug 31 19:18:44.470765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:44.475488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 102/200] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:18:44 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-interface => generated 284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:44.481335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:44.482183 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:44.490742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:44.491491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:44.492100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:44.494032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:44.494494 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:44.497189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:44.497923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:44.502799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:44.504241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8b8a7116-2f75-43f3-aed0-3fd6847f16a8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1596 microversion: 2.20 time: 1.074437 Aug 31 19:18:44.504975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 99/201] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:18:43 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1596 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:44.532483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:44.533447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:44.555480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:44.557420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:44.561256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:44.562215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:44.562823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:44.563416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.094351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd2468f0-8e3a-45e1-9720-88fa1ae26275 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.566582 Aug 31 19:18:45.103497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 100/202] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:18:44 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-interface => generated 284 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:45.110003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:45.111531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:45.127530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:45.128240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:45.129691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.130664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:45.131401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:45.132029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.158752 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:45.171857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2715b9e4-7ac7-4059-be26-519902401eb8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.694396 Aug 31 19:18:45.172471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 103/203] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:44 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:45.181833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:45.182579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:45.193310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:45.193809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:45.194214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.195117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:45.195729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:45.196146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:45.564964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7d9da73b-b803-4261-a0c2-bcfdf77fb104 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.391365 Aug 31 19:18:45.565552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 104/204] 10.222.0.95 () {60 vars in 1316 bytes} [Wed Aug 31 19:18:45 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-interface => generated 284 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:45.838912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:45.849489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-18dfdf29-d1f1-4e68-b230-ab586383835d tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.744532 Aug 31 19:18:45.851220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 101/205] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:45 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:46.193476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:46.194238 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:46.206275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:46.206804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:46.207279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:46.207962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:46.208410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:46.208890 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:46.831097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:46.870748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5699b154-65e0-42bd-83a8-163172349e4a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.681486 Aug 31 19:18:46.874909 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 105/206] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:46 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:46.887016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:46.889350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:46.897086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:46.897998 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:46.898715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:46.900350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:46.901081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:46.901715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.271512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:47.281789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-739bba7f-69f5-4b41-ad41-f339d8ddb000 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.412804 Aug 31 19:18:47.283270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 102/207] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:46 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:47.897844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:47.899596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:47.915932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.918677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.921662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-7de3476d-c444-4603-a604-498d4eec1610 req-06709fbe-b7b8-4a40-b753-aace22db0186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9952e4e3-5b71-4512-8bc4-cd0339fc24c7", "tag": "9b68f3b2-a4ed-4d2d-8371-adf91acb6cac"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:47.922611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.925770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.928369 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.930613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.932008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7de3476d-c444-4603-a604-498d4eec1610 req-06709fbe-b7b8-4a40-b753-aace22db0186 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:47.932500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7de3476d-c444-4603-a604-498d4eec1610 req-06709fbe-b7b8-4a40-b753-aace22db0186 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:47.933147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7de3476d-c444-4603-a604-498d4eec1610 req-06709fbe-b7b8-4a40-b753-aace22db0186 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:47.947477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-7de3476d-c444-4603-a604-498d4eec1610 req-06709fbe-b7b8-4a40-b753-aace22db0186 service nova] Creating event network-changed:9b68f3b2-a4ed-4d2d-8371-adf91acb6cac for instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 on hv-cinder-85221 Aug 31 19:18:47.952989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-7de3476d-c444-4603-a604-498d4eec1610 req-06709fbe-b7b8-4a40-b753-aace22db0186 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034838 Aug 31 19:18:47.957715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 103/208] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:47.986141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-8a0069e3-a4cf-4bef-9ef4-38064297c71f req-b9dcc77b-46e6-4eb2-9d59-5fed97eb92ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e955cd6-de98-48e5-90af-020d4952bc40", "tag": "28578596-0058-4fd6-b56b-d8ccf5626348"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:48.002594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-8a0069e3-a4cf-4bef-9ef4-38064297c71f req-b9dcc77b-46e6-4eb2-9d59-5fed97eb92ac service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:48.003266 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-8a0069e3-a4cf-4bef-9ef4-38064297c71f req-b9dcc77b-46e6-4eb2-9d59-5fed97eb92ac service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:48.004405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-8a0069e3-a4cf-4bef-9ef4-38064297c71f req-b9dcc77b-46e6-4eb2-9d59-5fed97eb92ac service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:48.043077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-8a0069e3-a4cf-4bef-9ef4-38064297c71f req-b9dcc77b-46e6-4eb2-9d59-5fed97eb92ac service nova] Creating event network-changed:28578596-0058-4fd6-b56b-d8ccf5626348 for instance 4e955cd6-de98-48e5-90af-020d4952bc40 on hv-cinder-85221 Aug 31 19:18:48.048895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-8a0069e3-a4cf-4bef-9ef4-38064297c71f req-b9dcc77b-46e6-4eb2-9d59-5fed97eb92ac service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066769 Aug 31 19:18:48.049702 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 104/209] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:48.204961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:48.215654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7116a1bb-e1b1-475b-9e51-003f3e02875f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.324088 Aug 31 19:18:48.216249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 106/210] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:47 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:48.307832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:48.308443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:48.320820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:48.321311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:48.321746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:48.325430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:48.329306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:48.334759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:48.436411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2f4e8ed6-2f07-4fc1-b1d2-d041db3b4114 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Action: 'create', calling method: .version_select at 0x7f975fe4b700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1723245013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6AbUXqRd8cegcHLXJlAMoIlPCI3ilA2J6PH9nLMfmIs5hi0N2d+dGuycLuonc7/s9oYcOS/Ne7owEzTkBLTiVrLyqsuH2iLxqVmm+Po4ZSknVcxoZZlY8OuTp3zyYmlQ=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:48.481306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-2f4e8ed6-2f07-4fc1-b1d2-d041db3b4114 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Getting quotas for project 85c019992192497d9832594a889da9bf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:18:48.492257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-2f4e8ed6-2f07-4fc1-b1d2-d041db3b4114 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Getting quotas for user 854d5db6c7f64422a946d5284570e1be and project 85c019992192497d9832594a889da9bf. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:18:48.530505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2f4e8ed6-2f07-4fc1-b1d2-d041db3b4114 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.410451 Aug 31 19:18:48.532556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 105/211] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:18:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:48.540639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:48.552936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-09629c83-0c26-44a1-86ac-746a2ae398c9 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.249328 Aug 31 19:18:48.553549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 107/212] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:48 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:49.240942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:49.241767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:49.260316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:49.260846 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:49.263949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:49.264754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:49.265233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:49.268619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:49.575755 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:49.577221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:49.591757 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:49.595431 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:49.596197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:49.601041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:49.606183 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:49.617239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:49.617873 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:49.621708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b5d2b3b4-b4b7-4481-b6cf-a6f3c5b12978 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.380059 Aug 31 19:18:49.622375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 106/213] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:49 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:50.073332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-f8b20967-614f-4715-a58f-1be3382f6b30 req-939b8969-e45b-4681-a8e4-9d1b6497d083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:50.093578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-f8b20967-614f-4715-a58f-1be3382f6b30 req-939b8969-e45b-4681-a8e4-9d1b6497d083 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:50.099512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-f8b20967-614f-4715-a58f-1be3382f6b30 req-939b8969-e45b-4681-a8e4-9d1b6497d083 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:50.099994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-f8b20967-614f-4715-a58f-1be3382f6b30 req-939b8969-e45b-4681-a8e4-9d1b6497d083 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:50.131825 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-f8b20967-614f-4715-a58f-1be3382f6b30 req-939b8969-e45b-4681-a8e4-9d1b6497d083 service nova] Creating event network-changed:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:18:50.147381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-f8b20967-614f-4715-a58f-1be3382f6b30 req-939b8969-e45b-4681-a8e4-9d1b6497d083 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079782 Aug 31 19:18:50.148317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 107/214] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:50.234612 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:50.262508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b3dbba27-6d0d-4f63-930c-9db0790e677a tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.691131 Aug 31 19:18:50.268428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 108/215] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:49 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:50.646261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:50.647016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:50.657586 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:50.658132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:50.658776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:50.668869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:50.669701 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:50.671693 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:51.258862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:51.289435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fe590fe2-9252-4f35-a2e9-76bce994b70e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.645061 Aug 31 19:18:51.296051 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:51.298150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:51.307932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 108/216] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:50 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:51.337696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:51.338271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:51.338781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:51.341115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:51.342558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:51.343062 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:51.386986 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:51.590897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:51.605795 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-96a76e3e-a69c-48be-aa4c-7ab8a886541b tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.316786 Aug 31 19:18:51.608005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 109/217] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:51 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:52.318628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:52.319170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:52.325466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:52.326001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:52.326430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:52.327120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:52.327565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:52.327979 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:52.502311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:52.511459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-45bb3023-2820-411f-853a-dadc631d44cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.197917 Aug 31 19:18:52.512040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 109/218] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:52 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:52.630283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:52.630889 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:52.637107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:52.637842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:52.638482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:52.639184 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:52.639640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:52.640065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:52.810593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:52.820165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b937bb6-c489-4064-9d54-4538c64c4c83 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1315 microversion: 2.1 time: 0.194204 Aug 31 19:18:52.820847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 110/219] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:52 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:53.536020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:53.537122 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:53.544554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:53.545273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:53.546684 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:53.551513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:53.552178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:53.553414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:53.719201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:53.727444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c59b930f-936f-4d89-8f2e-0ee8a1ebc11c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.197905 Aug 31 19:18:53.728017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 110/220] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:53 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:53.842583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:53.843230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:53.850240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:53.850733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:53.851184 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:53.851874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:53.852326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:53.852795 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:54.119219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:54.130737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ab1bc455-88d7-48fb-833f-94cdeab6f3c6 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1502 microversion: 2.1 time: 0.292070 Aug 31 19:18:54.140640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 111/221] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:53 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:54.436823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-498072147", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "networks": [{"uuid": "edf157c3-c858-4e0d-b960-a3d1afe76025"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:54.515393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] validate_networks() for [('edf157c3-c858-4e0d-b960-a3d1afe76025', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:18:54.754028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:54.756743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:54.766001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:54.766494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:54.766938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:54.767641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:54.768097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:54.768525 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:55.224169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:55.232529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-28129d3b-df04-4b0a-9aae-141acf853e54 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1322 microversion: 2.1 time: 0.487739 Aug 31 19:18:55.234288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 112/222] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:54 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:18:55.238760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:18:55.239899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:18:55.240741 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:18:55.241447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:18:55.242135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:18:55.255372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:55.255985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:55.256660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:55.257576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:55.258218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:55.258838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:55.279254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Getting quotas for project 47b4c76757374438b8d4b0b7148be568. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:18:55.284287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Getting quotas for user b7c7e84a2809475cb7fbfaf905c2ad5c and project 47b4c76757374438b8d4b0b7148be568. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:18:55.300002 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:18:55.303052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:18:55.364780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f5a244af-72b1-447a-a372-5c8571a8e69a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931807 Aug 31 19:18:55.365800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 111/223] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:18:55.376375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-63582ad9-aac2-44d5-b5a1-88a1a68e29cb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:55.377024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-63582ad9-aac2-44d5-b5a1-88a1a68e29cb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:55.452501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-63582ad9-aac2-44d5-b5a1-88a1a68e29cb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:55.460082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-63582ad9-aac2-44d5-b5a1-88a1a68e29cb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1213 microversion: 2.1 time: 0.087349 Aug 31 19:18:55.460610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 113/224] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:55 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:55.743529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be388e50-3344-4fcb-8004-b2606f959c8d"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:55.746613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:55.752944 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:55.753896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:55.754567 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:55.755458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:55.755921 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:55.756400 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.257590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:56.258213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:56.265107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.265608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.266045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.266754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.267210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.267710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.415520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:56.423712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c617ba1a-2d3c-4964-853e-8323265d5982 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1515 microversion: 2.1 time: 0.171358 Aug 31 19:18:56.424291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 114/225] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:56 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:56.445409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:56.447689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:56.453908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.454386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.454948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.455650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.456132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.457301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.484129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'flavor' on Instance uuid fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:18:56.630154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e1c4b4da-547d-4b9a-af1c-f14008aa24a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a/action" status: 200 len: 32 microversion: 2.1 time: 0.187807 Aug 31 19:18:56.631107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 115/226] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:18:56 2022] POST /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 19:18:56.639646 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:56.640462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:56.648900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.649680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.650824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.651750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.652442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.653078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.730077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:56.739277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-42628cb4-5037-4cfe-8832-5c2481d5d080 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1217 microversion: 2.1 time: 0.106508 Aug 31 19:18:56.739854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 116/227] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:56 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:56.759395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:56.760003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:56.766398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.766883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.767314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.768159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:56.768631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:56.769940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:56.930270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:56.939321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d0e9989d-fbcd-46fa-a28a-4dba3443e687 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.197284 Aug 31 19:18:56.939898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 117/228] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:56 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:57.475604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3e55cccc-fe19-4af8-b41e-ad394d1dcb60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "POST /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.736426 Aug 31 19:18:57.481906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 112/229] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:18:55 2022] POST /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8/os-volume_attachments => generated 194 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:57.761052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:57.761657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:57.767788 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:57.768290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:57.768773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:57.770199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:57.770897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:57.771285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:57.876602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:57.886567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ef0e59ad-96ca-4b99-b536-2d6e633a55f1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1265 microversion: 2.1 time: 0.129659 Aug 31 19:18:57.887149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 118/230] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:57 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:57.964723 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:57.965414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:57.972201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:57.972814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:57.973252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:57.973934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:57.974376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:57.974794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:58.187584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:58.196885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-de66cd39-4ca1-4999-bdb4-fa8657e8b5bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.236753 Aug 31 19:18:58.202897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 113/231] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:57 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:58.907351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:58.907944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:58.914288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:58.914772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:58.915204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:58.915893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:58.916345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:58.916802 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:58.981905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:58.991839 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fd19b4a5-da67-49cf-b4a7-85ccd57b6c51 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1273 microversion: 2.1 time: 0.088042 Aug 31 19:18:58.992161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 119/232] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:58 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:59.219583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:59.220229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:18:59.227219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:59.227804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:59.228246 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:59.229186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:18:59.229497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:18:59.229920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:18:59.648746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:18:59.652985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:59.659597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f43667d8-35c1-409c-bd6d-b5cdf1d8b9f0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.444787 Aug 31 19:18:59.660785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 114/233] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:18:59 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:00.014015 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:00.015343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:00.026736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:00.027224 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:00.027655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:00.028353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:00.028825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:00.029245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:00.234256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:00.243189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e216b0f3-7337-485a-b7ac-4f5cc39648b8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.233571 Aug 31 19:19:00.243962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 120/234] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:00 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:00.682525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:00.683282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:00.690417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:00.691013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:00.691459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:00.692163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:00.692640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:00.693062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:00.879079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-7b452013-2920-4696-ae19-cc3020ea1c0a req-98dc1aee-dde3-441c-80f3-2b774c8e124d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15f631e-c36b-4d00-b270-717d16c682d6", "tag": "31fc1678-aa2c-4fba-a670-ac2fd1ab785e"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:00.888385 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7b452013-2920-4696-ae19-cc3020ea1c0a req-98dc1aee-dde3-441c-80f3-2b774c8e124d service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:00.888887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7b452013-2920-4696-ae19-cc3020ea1c0a req-98dc1aee-dde3-441c-80f3-2b774c8e124d service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:00.889497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7b452013-2920-4696-ae19-cc3020ea1c0a req-98dc1aee-dde3-441c-80f3-2b774c8e124d service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:00.900343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-7b452013-2920-4696-ae19-cc3020ea1c0a req-98dc1aee-dde3-441c-80f3-2b774c8e124d service nova] Creating event network-changed:31fc1678-aa2c-4fba-a670-ac2fd1ab785e for instance d15f631e-c36b-4d00-b270-717d16c682d6 on hv-cinder-85221 Aug 31 19:19:00.905563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-7b452013-2920-4696-ae19-cc3020ea1c0a req-98dc1aee-dde3-441c-80f3-2b774c8e124d service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030339 Aug 31 19:19:00.906143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 121/235] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:00.926147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:00.934779 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-742b6feb-cf2b-4c28-8c92-a2aa0c58972a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.256692 Aug 31 19:19:00.935458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 115/236] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:00 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:01.264948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:01.265644 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:01.272454 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:01.272967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:01.273406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:01.274097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:01.274545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:01.274969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:01.411958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:01.420254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-81f5ca2d-63e4-4275-82ce-bb12d9ba4f02 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.159540 Aug 31 19:19:01.421125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 122/237] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:01 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:01.956427 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:01.957124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:01.965158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:01.965691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:01.966176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:01.967006 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:01.967502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:01.967963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:02.099966 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:02.107551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-13b90eb3-15b5-42ae-9c16-2b2515d3f8f5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.155044 Aug 31 19:19:02.108119 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 116/238] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:01 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:02.441377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:02.442005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:02.447933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:02.448409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:02.448878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:02.449568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:02.450017 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:02.450435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:02.582301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:02.590495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-70d6a322-c7a6-43e2-84af-d2e2cd98f4c7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.153012 Aug 31 19:19:02.591057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 123/239] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:02 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:03.130243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:03.130887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:03.136895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:03.137383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:03.137817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:03.138514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:03.138962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:03.139383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:03.274320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:03.281966 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4727aabb-0358-4792-b3f9-a9eccb7ab886 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.157432 Aug 31 19:19:03.282533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 117/240] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:03 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:03.611680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:03.612220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:03.614669 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=89 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:03.620094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:03.620612 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:03.621052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:03.621762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:03.622217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:03.622643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:03.764158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:03.772221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b7dbed7e-58b8-494e-add8-00faa9041933 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.164452 Aug 31 19:19:03.772820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 124/241] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:03 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:04.302805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:04.303423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:04.310065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:04.310550 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:04.310984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:04.311683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:04.312135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:04.312558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:04.593531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:04.602529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ef48220d-0789-498b-afb0-c3a20343e69b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.303543 Aug 31 19:19:04.603111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 118/242] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:04 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:04.794304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:04.794909 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:04.803188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:04.804450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:04.804450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:04.805295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:04.807057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:04.807057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:05.000246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:05.004398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:05.009599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7e5d0d04-4aa7-438d-b17b-d3a3a5580ca3 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.219102 Aug 31 19:19:05.010174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 125/243] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:04 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:05.623052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:05.623663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:05.625545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:05.626291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=10 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:05.633935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:05.634421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:05.634859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:05.635560 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:05.636016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:05.636444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:05.770906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:05.778699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b2f2b882-e060-455e-a369-262cca93d6c9 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.159381 Aug 31 19:19:05.779267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 119/244] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:05 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:06.029853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:06.030472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:06.032814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:06.039313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:06.039796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:06.040235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:06.041047 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:06.041512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:06.041979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:06.183827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:06.192127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c4c8ad90-97cd-4b38-85d4-91256970d56a tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.166027 Aug 31 19:19:06.192959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 126/245] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:06 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:06.799088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:06.799693 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:06.806835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:06.808130 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:06.808130 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:06.808456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:06.808899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:06.809458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:06.948773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:06.959770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e8220df7-3618-4348-82df-923d7fae4cc8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.164174 Aug 31 19:19:06.961658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 120/246] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:06 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:07.213124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:07.213736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:07.219718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:07.220724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:07.220724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:07.221480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:07.222102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:07.222737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:07.357211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:07.366396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-48618a39-b071-43f4-8272-982c1e415feb tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.157405 Aug 31 19:19:07.366957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 127/247] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:07 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:07.982791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:07.983398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:07.985822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:07.991817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:07.992300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:07.992780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:07.993470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:07.993923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:07.994351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:08.136399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:08.148109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7cee9f37-f37d-4c7c-96f9-c87afa547d5f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.169245 Aug 31 19:19:08.149054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 121/248] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:07 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:08.396138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:08.397642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:08.404291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:08.404922 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:08.405553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:08.406553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:08.407313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:08.408043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:08.583640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:08.598446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc0460fe-1de5-4b4f-8b38-cb7374e5a992 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.214185 Aug 31 19:19:08.599028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 128/249] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:08 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:09.177835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:09.178523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:09.185556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:09.186050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:09.186523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:09.187305 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:09.187754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:09.188190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:09.328076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:09.337850 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-753853a4-3181-491d-b7e0-9d704aab38b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.166229 Aug 31 19:19:09.338927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 122/250] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:09 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:09.622253 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:09.623265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:09.631323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:09.631898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:09.632410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:09.633212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:09.633734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:09.634232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:09.783892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:09.793040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-79f368be-0986-48e9-aa3f-c7da2a0c4dbd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.177113 Aug 31 19:19:09.793804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 129/251] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:09 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:10.363739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:10.364289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:10.370914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.371404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.371846 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.372555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.373131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.373569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.547841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:10.556214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7698ea14-745b-4c7c-91c8-6a989ddd430f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.196992 Aug 31 19:19:10.557132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 123/252] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:10 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:10.824102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:10.825059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:10.838784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.839969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.840176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:10.840786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:10.845458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:10.845979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.004204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:11.012984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1bc08d3d-a5e7-4a88-865e-5cd71e8bc3a2 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.201478 Aug 31 19:19:11.013995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 130/253] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:10 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:11.291078 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-2928c97e-d3cb-4341-a571-ce579eee0df6 req-46dc876b-dac3-48eb-b087-a3139314a9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15f631e-c36b-4d00-b270-717d16c682d6", "name": "network-vif-plugged", "status": "completed", "tag": "31fc1678-aa2c-4fba-a670-ac2fd1ab785e"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:11.316216 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2928c97e-d3cb-4341-a571-ce579eee0df6 req-46dc876b-dac3-48eb-b087-a3139314a9c3 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.316730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2928c97e-d3cb-4341-a571-ce579eee0df6 req-46dc876b-dac3-48eb-b087-a3139314a9c3 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.317161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2928c97e-d3cb-4341-a571-ce579eee0df6 req-46dc876b-dac3-48eb-b087-a3139314a9c3 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.336610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-2928c97e-d3cb-4341-a571-ce579eee0df6 req-46dc876b-dac3-48eb-b087-a3139314a9c3 service nova] Creating event network-vif-plugged:31fc1678-aa2c-4fba-a670-ac2fd1ab785e for instance d15f631e-c36b-4d00-b270-717d16c682d6 on hv-cinder-85221 Aug 31 19:19:11.342148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-2928c97e-d3cb-4341-a571-ce579eee0df6 req-46dc876b-dac3-48eb-b087-a3139314a9c3 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055822 Aug 31 19:19:11.343130 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 124/254] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:11.578481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:11.579365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:11.586342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.587147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.588028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.589469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.590258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.590785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.610808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:11.611599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:11.618545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.619007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.619442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.620375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.620823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.621250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.677465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:19:11.801557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d487b2ec-5faf-4a24-b7a0-332929e5ef79 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "DELETE /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 204 len: 0 microversion: 2.1 time: 0.194871 Aug 31 19:19:11.802535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 125/255] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:19:11 2022] DELETE /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:19:11.812397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:11.813392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:11.821406 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.821895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.822335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.823092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:11.823714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:11.824144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:11.842239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:11.850897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-81d136cb-699f-4905-bc2e-6cc2ba9ca225 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.276202 Aug 31 19:19:11.851466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 131/256] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:11 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:11.979593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:11.988412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-44249400-b8b9-4833-9595-648b8f4f8759 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1554 microversion: 2.1 time: 0.179937 Aug 31 19:19:11.989056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 126/257] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:11 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:12.041059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:12.041668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:12.047636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:12.048115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:12.048546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:12.049329 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:12.049869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:12.050470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:12.229168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:12.239741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-69041c42-cb5a-48f8-917b-340ae9b71d7d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.202529 Aug 31 19:19:12.241074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 132/258] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:12 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:12.872512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:12.873147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:12.881383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:12.881970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:12.882475 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:12.883251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:12.883704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:12.884125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:13.013421 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:13.014680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:13.021993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:13.024758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:13.025209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:13.025955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:13.026408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:13.026836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:13.035614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:13.044010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d097e620-df71-4cbb-b26c-5c1c32c51666 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.175656 Aug 31 19:19:13.044861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 127/259] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:12 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:13.196855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:13.206128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7a4d2e92-1922-4170-807f-dba90260e3c5 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1554 microversion: 2.1 time: 0.196995 Aug 31 19:19:13.207113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 133/260] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:13 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:13.263858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:13.264403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:13.271664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:13.272155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:13.272623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:13.273319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:13.273772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:13.274194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:13.813398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:13.821736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f7d8c26-545e-42c0-8668-4c6eccb9c6ee tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.561794 Aug 31 19:19:13.822313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 128/261] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:13 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:14.067505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:14.067996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:14.074281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.074771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.075205 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.075974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.076629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.077066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.224247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:14.230647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:14.231269 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:14.233661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e6faf2d5-4e7e-4dea-93ae-eb9f91d62711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.170731 Aug 31 19:19:14.234238 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 134/262] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:14 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:14.248300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.249102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.249544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.250252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.250694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.251182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.408940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:14.418619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6b80e80a-cb84-470e-85c1-c7c3aec64458 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1554 microversion: 2.1 time: 0.195247 Aug 31 19:19:14.419546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 129/263] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:14 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:14.843918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:14.843918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:14.854155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.854645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.855077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:14.855788 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:14.856235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:14.856724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.012812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:15.021551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b36823d8-05bd-446b-a221-e20373cf4d25 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.182100 Aug 31 19:19:15.022125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 135/264] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:14 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:15.255890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:15.256561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:15.264887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:15.265369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:15.265801 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.267181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:15.267181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:15.267738 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.292343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:15.421118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:15.430030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-079533b3-fdfa-4a8c-8260-3081d0f0e57e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.178653 Aug 31 19:19:15.430659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 130/265] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:15 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:15.444473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:15.445674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:15.450938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:15.451810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:15.451810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.452919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:15.453109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:15.453494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:15.597250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:15.606710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8d8b2201-f34d-4b10-bbe6-ea53000d66a7 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1554 microversion: 2.1 time: 0.167021 Aug 31 19:19:15.607346 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 136/266] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:15 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:16.043471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:16.044109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:16.051210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.051698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.052132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.052893 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.053475 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.053759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.208731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:16.216748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e4c37ccd-5e79-438a-9f19-bbb9c82b8d86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1313 microversion: 2.1 time: 0.177162 Aug 31 19:19:16.218273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 131/267] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:16 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:16.452548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:16.453337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:16.462174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.462754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.463261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.464043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.464497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.464959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.631769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:16.632835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:16.635957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:16.643098 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.644486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.645241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.646410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:16.647148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:16.647840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:16.649074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f41308ed-cbf5-4b09-aa4b-3173402465cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.200630 Aug 31 19:19:16.650015 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 137/268] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:16 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:16.835292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:16.845162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-380e20d5-e34d-4459-aa43-e508001d25e3 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1554 microversion: 2.1 time: 0.219703 Aug 31 19:19:16.845736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 132/269] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:16 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:17.240872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:17.241876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:17.251736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.252611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.253758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.254840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.255613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.256334 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.408540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:17.417674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e4188159-af6f-428c-938b-b3e9674cb335 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1496 microversion: 2.1 time: 0.183125 Aug 31 19:19:17.418234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 138/270] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:17 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1496 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:17.673530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:17.674260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:17.681970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.682469 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.682897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.683670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.684124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.684596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.870384 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:17.871631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:17.879868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.880363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.880839 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.881550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:17.881999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:17.882423 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:17.939940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:17.948381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-37a4b6bb-c779-4748-acfe-a5cf4b5cec9e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.278930 Aug 31 19:19:17.949062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 133/271] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:17 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:18.134508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:18.143142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-423c53b6-1c2c-45ce-944a-50a41a801ee8 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1554 microversion: 2.1 time: 0.277989 Aug 31 19:19:18.144001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 139/272] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:17 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1554 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:18.254772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:18.255262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:18.261875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.262357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.262790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.263486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.263934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.264352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.294396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:19:18.387497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-11f8bc29-bec6-4523-9720-cffe8605252f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "DELETE /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 204 len: 0 microversion: 2.1 time: 0.136304 Aug 31 19:19:18.388656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 134/273] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:19:18 2022] DELETE /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:19:18.401799 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:18.402831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:18.412509 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.413687 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.414303 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.415361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.415968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.416531 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.441211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-50104ee5-f0db-4172-b5f0-ad8fc1c6c83a req-a51c59bd-5834-4159-a7e9-65a69edb4e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b6f9fc-d26a-4175-8aa9-c450f6d605d8", "name": "network-vif-deleted", "tag": "a028882f-9afc-4b60-9bcc-546d9758006b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:18.451284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-50104ee5-f0db-4172-b5f0-ad8fc1c6c83a req-a51c59bd-5834-4159-a7e9-65a69edb4e74 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.451858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-50104ee5-f0db-4172-b5f0-ad8fc1c6c83a req-a51c59bd-5834-4159-a7e9-65a69edb4e74 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.452356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-50104ee5-f0db-4172-b5f0-ad8fc1c6c83a req-a51c59bd-5834-4159-a7e9-65a69edb4e74 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.465127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-50104ee5-f0db-4172-b5f0-ad8fc1c6c83a req-a51c59bd-5834-4159-a7e9-65a69edb4e74 service nova] Creating event network-vif-deleted:a028882f-9afc-4b60-9bcc-546d9758006b for instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 on hv-cinder-85221 Aug 31 19:19:18.470942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-50104ee5-f0db-4172-b5f0-ad8fc1c6c83a req-a51c59bd-5834-4159-a7e9-65a69edb4e74 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034305 Aug 31 19:19:18.472201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 135/274] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:18.571452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:18.579380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-28d0d27d-df4b-4096-a6cf-67222e60dd2c tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1502 microversion: 2.1 time: 0.186088 Aug 31 19:19:18.579936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 140/275] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:18 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:18.970771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:18.971607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:18.977934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.978442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.978878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:18.979619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:18.980073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:18.980498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.126616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:19.137153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7abf7839-ca83-4dbb-9721-135d157579d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.171151 Aug 31 19:19:19.137722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 136/276] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:18 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:19.168464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:19.171328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:19.180349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:19.180866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:19.181309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.181999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:19.182449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:19.182870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.253468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:19.261780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a19bf6dc-6148-4d5a-9ada-ebab6f094e60 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1512 microversion: 2.1 time: 0.099844 Aug 31 19:19:19.262341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 141/277] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:19 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:19.601965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:19.602479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:19.608336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:19.608845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:19.609276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.609953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:19.610396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:19.610816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:19.754873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:19.763660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1fd55277-ef43-4053-8725-a6d235134626 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1502 microversion: 2.1 time: 0.165664 Aug 31 19:19:19.764532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 137/278] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:19 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:20.159409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:20.160020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:20.166335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:20.166817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:20.167255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:20.167941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:20.168394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:20.168843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:20.187080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:20.286135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:20.286870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:20.294459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:20.296999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:20.296999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:20.296999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:20.296999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:20.297948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:20.304987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:20.313887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ffbaa199-8264-402f-8d0d-aef8bb27a34e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.158293 Aug 31 19:19:20.314468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 142/279] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:20 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:20.366896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:20.375093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-76b81159-8484-4a1a-80ab-fb533459db84 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1512 microversion: 2.1 time: 0.093296 Aug 31 19:19:20.375735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 138/280] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:20 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:20.786759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:20.787643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:20.794198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:20.794682 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:20.795112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:20.795867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:20.796353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:20.796799 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:20.948554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:20.957450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-71fda340-7006-4a85-b318-3ae93ce0dd88 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1502 microversion: 2.1 time: 0.175400 Aug 31 19:19:20.958028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 143/281] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:20 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:21.335506 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:21.336086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:21.342457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.342927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.343354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.344040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.344485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.344931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.399699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:21.400328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:21.408696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.410020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.410944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.411892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.412359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.412818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.493593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:21.502328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-30b1405f-4d8a-421e-a063-0e968254c4f0 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1346 microversion: 2.1 time: 0.109448 Aug 31 19:19:21.506045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 144/282] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:21 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:21.600467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:21.608440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-59549977-78cb-4d99-9e6a-b73fbd42ac0f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.276871 Aug 31 19:19:21.609129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 139/283] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:21 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:21.964813 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-b5560c9a-43a1-487e-abbc-77b2d27d1d88 req-41eb9c23-3145-4850-97c1-5ddece5a0c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15f631e-c36b-4d00-b270-717d16c682d6", "name": "network-vif-deleted", "tag": "31fc1678-aa2c-4fba-a670-ac2fd1ab785e"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:21.977870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b5560c9a-43a1-487e-abbc-77b2d27d1d88 req-41eb9c23-3145-4850-97c1-5ddece5a0c82 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.978589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b5560c9a-43a1-487e-abbc-77b2d27d1d88 req-41eb9c23-3145-4850-97c1-5ddece5a0c82 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.979198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b5560c9a-43a1-487e-abbc-77b2d27d1d88 req-41eb9c23-3145-4850-97c1-5ddece5a0c82 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.981035 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:21.981762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:21.991962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.992403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.993320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.995164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:21.995768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:21.996328 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:21.999506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-b5560c9a-43a1-487e-abbc-77b2d27d1d88 req-41eb9c23-3145-4850-97c1-5ddece5a0c82 service nova] Creating event network-vif-deleted:31fc1678-aa2c-4fba-a670-ac2fd1ab785e for instance d15f631e-c36b-4d00-b270-717d16c682d6 on hv-cinder-85221 Aug 31 19:19:22.005097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-b5560c9a-43a1-487e-abbc-77b2d27d1d88 req-41eb9c23-3145-4850-97c1-5ddece5a0c82 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044991 Aug 31 19:19:22.005860 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 145/284] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:22.110933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:22.120531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ad881646-3920-4d5e-a7d0-630087b43f86 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1460 microversion: 2.1 time: 0.144637 Aug 31 19:19:22.121935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 140/285] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:21 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1460 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:22.524959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:22.525660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:22.532069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.532553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.533017 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.533728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.534369 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.534999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.567677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.568162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.568630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.569084 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lazy-loading 'fault' on Instance uuid 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:19:22.616715 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97c9201758884fdbb080f85337a5ce87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccec772d24645ce8f5e58de8ee5e47c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:22.625453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1efe86d1-20db-420d-9337-cb3768b74f2f tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 200 len: 1351 microversion: 2.1 time: 0.104842 Aug 31 19:19:22.626029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 146/286] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:22 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:22.630485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:22.631108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:22.640718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.641743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.642425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.643201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:22.644297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:22.644763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:22.782088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:22.791662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4d44c42d-da3a-4d91-b4d0-72c5dfb640f7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.165946 Aug 31 19:19:22.792332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 141/287] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:22 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:23.122765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-802873384", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1723245013", "security_groups": [{"name": "tempest-secgroup-smoke-518018938"}], "networks": [{"uuid": "bbc21e41-fb95-4c2f-9577-581ea4907c41"}], "block_device_mapping_v2": [{"uuid": "e2578aa1-78bb-4f33-90cf-f53358f10e04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:23.146304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:23.147319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:23.158185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.159208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.160233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.162267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.162980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.165370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.198668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.198972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.199533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.199863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lazy-loading 'fault' on Instance uuid d15f631e-c36b-4d00-b270-717d16c682d6 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:19:23.273240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:23.280936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-777a7b34-dd0e-4e64-92b6-63325c15e2ad tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 200 len: 1303 microversion: 2.1 time: 0.140803 Aug 31 19:19:23.281526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 142/288] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:23 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:23.292115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] validate_networks() for [('bbc21e41-fb95-4c2f-9577-581ea4907c41', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:19:23.651449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:23.652445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:23.660242 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.660863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.661407 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.662200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.662765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.664499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.687660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] HTTP exception thrown: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Request method failure captured: Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 HTTP/1.1 Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7Pd6Ni_DfUOzx8dmIK4PBhDEtryn6VSjkUHx4xgLOg4ru9LmjAocMiUrTnzGPtbDmkfRU4Z1MjMw2HeLccQGyuiH24JnGQkYdn30GUJD0HF0U8NQrVcM8sRmiOI3X-YXEO3e_vh4gzwTzUm045G0g-FifZHZE46U-LG88WKUoSOdRM Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:19:23.693388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 97c9201758884fdbb080f85337a5ce87 Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:23.694711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '73b6f9fc-d26a-4175-8aa9-c450f6d605d8'} Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:23.695434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:23.697293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:23.698373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Returning 404 to user: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:23.698373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a62d3bad-e892-4128-bb07-eca0384ce5be tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 404 len: 111 microversion: 2.1 time: 0.048471 Aug 31 19:19:23.698373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 143/289] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:23 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:19:23.735109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:19:23.735670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:19:23.735987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:19:23.736391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:19:23.737855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:19:23.747296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.747773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.748205 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.748966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.749422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.749840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.773626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Getting quotas for project 85c019992192497d9832594a889da9bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:19:23.778442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Getting quotas for user 854d5db6c7f64422a946d5284570e1be and project 85c019992192497d9832594a889da9bf. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:19:23.814580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:23.816351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:23.823267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.823760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.824200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.824943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:23.825531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:23.826125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:23.856756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:19:23.859027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e2578aa1-78bb-4f33-90cf-f53358f10e04',volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:19:24.050573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:24.051969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4e5f7c1a-7031-4232-a5ec-146076252558 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.932835 Aug 31 19:19:24.052392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 147/290] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:19:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:19:24.057433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:24.059531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0cc1e1e2-d3f7-4ce8-be57-55fa49466860 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.248722 Aug 31 19:19:24.059977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:24.061075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 144/291] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:23 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:24.069025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fd4fbc3b-2c68-4da1-97bf-2756130d6619 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:24.070231 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fd4fbc3b-2c68-4da1-97bf-2756130d6619 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:24.083996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:24.084434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:24.084905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:24.085702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:24.086072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:24.086540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:24.101074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] HTTP exception thrown: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Request method failure captured: Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8/os-volume_attachments HTTP/1.1 Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7Pd6Ni_DfUOzx8dmIK4PBhDEtryn6VSjkUHx4xgLOg4ru9LmjAocMiUrTnzGPtbDmkfRU4Z1MjMw2HeLccQGyuiH24JnGQkYdn30GUJD0HF0U8NQrVcM8sRmiOI3X-YXEO3e_vh4gzwTzUm045G0g-FifZHZE46U-LG88WKUoSOdRM Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:19:24.105968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 97c9201758884fdbb080f85337a5ce87 Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:24.107503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'server_id': '73b6f9fc-d26a-4175-8aa9-c450f6d605d8'} Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:24.108258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:24.109376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.111753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Returning 404 to user: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:24.112884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4f09e8fd-51dc-4383-8174-caea12bf8c12 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059033 Aug 31 19:19:24.113470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 148/292] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:19:24 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:24.180227 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fd4fbc3b-2c68-4da1-97bf-2756130d6619 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:24.207698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fd4fbc3b-2c68-4da1-97bf-2756130d6619 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1088 microversion: 2.1 time: 0.144732 Aug 31 19:19:24.208811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 145/293] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:24 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1088 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:24.305798 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:24.306621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: d15f631e-c36b-4d00-b270-717d16c682d6] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:24.314995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:24.316513 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:24.318105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:24.319148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:24.320221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:24.321159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:24.338426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] HTTP exception thrown: Instance d15f631e-c36b-4d00-b270-717d16c682d6 could not be found. Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Request method failure captured: Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 HTTP/1.1 Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7QcMQ3N4BLNhsqo7P4V-Qq--3fnNIa8SJQ6DUH2OGacWGBb0py8m3hRsn2YjJfTsRPufYnwSNSPLz5opDNVb9drjTrNT5kjxvyznU20abSk_Ot-G9IxOlM1QIMiT4b_8p3SZP8ka6MnqB72ZMU7j80LEjuDm33Ol3LrKFnX4awoy9A Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 47b4c76757374438b8d4b0b7148be568 Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesActionsTest-182393730 Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:19:24.341092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/47b4c76757374438b8d4b0b7148be568"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/47b4c76757374438b8d4b0b7148be568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_47b4c76757374438b8d4b0b7148be568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/47b4c76757374438b8d4b0b7148be568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesActionsTest-182393730 Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 47b4c76757374438b8d4b0b7148be568 Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesActionsTest-182393730 Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesActionsTest-182393730-project Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: b7c7e84a2809475cb7fbfaf905c2ad5c Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesActionsTest-182393730-project Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance d15f631e-c36b-4d00-b270-717d16c682d6 could not be found. Aug 31 19:19:24.343143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'd15f631e-c36b-4d00-b270-717d16c682d6'} Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15f631e-c36b-4d00-b270-717d16c682d6 could not be found. Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:24.344269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15f631e-c36b-4d00-b270-717d16c682d6 could not be found. Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15f631e-c36b-4d00-b270-717d16c682d6 could not be found. Aug 31 19:19:24.355567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:24.357152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Returning 404 to user: Instance d15f631e-c36b-4d00-b270-717d16c682d6 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:24.357152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b3612ab1-6d63-48cb-92d5-a3a9f695d498 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6" status: 404 len: 111 microversion: 2.1 time: 0.042198 Aug 31 19:19:24.357152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 149/294] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:24 2022] GET /compute/v2.1/servers/d15f631e-c36b-4d00-b270-717d16c682d6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:24.479957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-589444720", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "networks": [{"uuid": "edf157c3-c858-4e0d-b960-a3d1afe76025"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:24.548391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] validate_networks() for [('edf157c3-c858-4e0d-b960-a3d1afe76025', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:19:25.034143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:19:25.035297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:19:25.035591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:19:25.036017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:19:25.036451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:19:25.047907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.048390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.049049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.050235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.050581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.051212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.072215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Getting quotas for project 47b4c76757374438b8d4b0b7148be568. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:19:25.083146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Getting quotas for user b7c7e84a2809475cb7fbfaf905c2ad5c and project 47b4c76757374438b8d4b0b7148be568. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:19:25.083659 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:25.084244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:25.095158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:19:25.095664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.096189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.097318 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.101678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:19:25.102549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.102549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.102549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.155913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3a9cbf0e-ad2d-468e-b376-4d19e2512293 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679827 Aug 31 19:19:25.156753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 146/295] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:19:25.169339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-73aaa986-6922-4373-9895-11edd8607b1f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:25.170066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-73aaa986-6922-4373-9895-11edd8607b1f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:25.499402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-73aaa986-6922-4373-9895-11edd8607b1f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:25.513502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-73aaa986-6922-4373-9895-11edd8607b1f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1213 microversion: 2.1 time: 0.347807 Aug 31 19:19:25.515236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 147/296] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:25 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1213 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:25.525506 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:25.527575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:25.541391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.542864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.543566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.544834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.545947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.546841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.608259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:25.624908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c1a96685-46a6-4176-b9d1-3093b5432059 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.545218 Aug 31 19:19:25.626165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 150/297] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:25 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:25.632189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:25.633236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:25.645865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.646642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.647246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.648109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.648937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.649528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.660724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:25.670473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] HTTP exception thrown: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.670658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5348e52b-8b23-4762-b008-e8e2088f1813 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1186 microversion: 2.1 time: 0.153608 Aug 31 19:19:25.671166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 148/298] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:25 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1186 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Request method failure captured: Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 HTTP/1.1 Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7Pd6Ni_DfUOzx8dmIK4PBhDEtryn6VSjkUHx4xgLOg4ru9LmjAocMiUrTnzGPtbDmkfRU4Z1MjMw2HeLccQGyuiH24JnGQkYdn30GUJD0HF0U8NQrVcM8sRmiOI3X-YXEO3e_vh4gzwTzUm045G0g-FifZHZE46U-LG88WKUoSOdRM Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:19:25.674127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 97c9201758884fdbb080f85337a5ce87 Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.675930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '73b6f9fc-d26a-4175-8aa9-c450f6d605d8'} Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:25.676941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.678477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.680747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Returning 404 to user: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:25.682012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-72b02742-8281-48e9-a841-11d4395e9ffe tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "DELETE /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 404 len: 111 microversion: 2.1 time: 0.054441 Aug 31 19:19:25.682587 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 151/299] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:19:25 2022] DELETE /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:25.699329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:25.700353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] [instance: 73b6f9fc-d26a-4175-8aa9-c450f6d605d8] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:25.709025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.709527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.710666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.710666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:25.711331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:25.711766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:25.718089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:25.730306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] HTTP exception thrown: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Request method failure captured: Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 HTTP/1.1 Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7Pd6Ni_DfUOzx8dmIK4PBhDEtryn6VSjkUHx4xgLOg4ru9LmjAocMiUrTnzGPtbDmkfRU4Z1MjMw2HeLccQGyuiH24JnGQkYdn30GUJD0HF0U8NQrVcM8sRmiOI3X-YXEO3e_vh4gzwTzUm045G0g-FifZHZE46U-LG88WKUoSOdRM Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:19:25.731868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/9ccec772d24645ce8f5e58de8ee5e47c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 9ccec772d24645ce8f5e58de8ee5e47c Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-DeleteServersTestJSON-796704210 Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 97c9201758884fdbb080f85337a5ce87 Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-DeleteServersTestJSON-796704210-project Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.733753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '73b6f9fc-d26a-4175-8aa9-c450f6d605d8'} Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:19:25.738141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. Aug 31 19:19:25.739412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:19:25.741036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] Returning 404 to user: Instance 73b6f9fc-d26a-4175-8aa9-c450f6d605d8 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:19:25.741036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b7e1b72d-82c8-4ce3-9900-29e10999c010 tempest-DeleteServersTestJSON-796704210 tempest-DeleteServersTestJSON-796704210-project] 10.222.0.95 "GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8" status: 404 len: 111 microversion: 2.1 time: 0.037963 Aug 31 19:19:25.741036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 149/300] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:25 2022] GET /compute/v2.1/servers/73b6f9fc-d26a-4175-8aa9-c450f6d605d8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:19:26.552050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:26.552725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:26.559432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.559915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.560352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.561076 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.561530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.561960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.640450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:26.650685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8dcc53ef-8ce7-4831-ad77-27efeba8da5e tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1209 microversion: 2.1 time: 0.103044 Aug 31 19:19:26.651397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 152/301] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:26 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:26.656661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:26.657265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:26.665815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.666826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.667283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.668091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.668755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.669361 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.698560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:26.701052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:26.710366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.711348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.712226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.713825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:26.714503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:26.715329 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:26.862924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:26.870685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-99ab3cd8-f614-4860-af38-20d444354a17 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1194 microversion: 2.1 time: 0.179239 Aug 31 19:19:26.871257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 153/302] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:26 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1194 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:27.056134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:27.069685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-95ca4de4-e5a5-478e-b635-21d8ae0234b8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.416290 Aug 31 19:19:27.070837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 150/303] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:26 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:27.679594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:27.680142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:27.686440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:27.687035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:27.687663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:27.688384 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:27.688929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:27.689475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:27.800764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:27.808324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8550c79f-c8b7-4f50-9cee-f74c05f0ac7f tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1209 microversion: 2.1 time: 0.133047 Aug 31 19:19:27.808929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 154/304] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:27 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:27.893958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:27.894638 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:27.903255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:27.903955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:27.904860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:27.905917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:27.906530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:27.907240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.094599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:28.095216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:28.101904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:28.102431 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:28.102855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.103559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:28.104007 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:28.104428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.213184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:28.224819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1d1274e4-ef08-41a6-afc6-3c881bfbed09 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1204 microversion: 2.1 time: 0.336700 Aug 31 19:19:28.225411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 151/305] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:27 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1204 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:28.513256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:28.521383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6eea871e-b048-4482-8a73-784aa00af15a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.430683 Aug 31 19:19:28.540820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 155/306] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:28 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:28.839889 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:28.840700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:28.847129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:28.847621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:28.848362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.849246 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:28.849774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:28.850274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:28.981324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:28.990027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e2d76eb1-10a3-4f95-816d-30aca4019267 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1265 microversion: 2.1 time: 0.156197 Aug 31 19:19:28.991272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 152/307] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:28 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:29.247697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:29.248413 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:29.259730 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.260675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.261264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.262118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.262720 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.263276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.506486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:29.519106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ee5ad2b5-a046-4e05-8bb6-92aca558341f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.275379 Aug 31 19:19:29.521012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 156/308] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:29 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:29.549395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:29.550775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:29.566052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.567961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.569933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.572230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.572832 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.576699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.662475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-c18cb6c4-16ba-4d9e-9b90-84e398a2b49c req-ae7c69a1-0614-433a-9fda-be69ab4113ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:29.717236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c18cb6c4-16ba-4d9e-9b90-84e398a2b49c req-ae7c69a1-0614-433a-9fda-be69ab4113ae service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:29.719570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c18cb6c4-16ba-4d9e-9b90-84e398a2b49c req-ae7c69a1-0614-433a-9fda-be69ab4113ae service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:29.720030 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c18cb6c4-16ba-4d9e-9b90-84e398a2b49c req-ae7c69a1-0614-433a-9fda-be69ab4113ae service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:29.748005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-c18cb6c4-16ba-4d9e-9b90-84e398a2b49c req-ae7c69a1-0614-433a-9fda-be69ab4113ae service nova] Creating event network-changed:facbf5d7-797a-4f5f-8a68-930bc7130258 for instance a83d3294-0902-4f21-a7b9-45b2b5229c52 on hv-cinder-85221 Aug 31 19:19:29.757177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-c18cb6c4-16ba-4d9e-9b90-84e398a2b49c req-ae7c69a1-0614-433a-9fda-be69ab4113ae service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099115 Aug 31 19:19:29.758131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 157/309] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:29.877348 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:29.903929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8fd9fdc5-896c-45f1-b95e-b7a89ae642d4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.355146 Aug 31 19:19:29.906428 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 153/310] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:29 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:30.013738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:30.014771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.027014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.030518 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.031308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.032315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.036333 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.037108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.201825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:30.212188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3f63ec3a-dacc-4ea2-9d1e-798df6626db9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1271 microversion: 2.1 time: 0.202946 Aug 31 19:19:30.213079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 158/311] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:30 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:30.541381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:30.542209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.552048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.552904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.553530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.554943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.555593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.556340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.913919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:30.930375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e0482821-914f-40fe-bfd4-093d70a765dc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.393222 Aug 31 19:19:30.931954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 154/312] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:30 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:30.934177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:30.934796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:30.946347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.947452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.949213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:30.951475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:30.953031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:30.954756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:31.204125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:31.214306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e4b46662-aeb9-4344-8336-ca164fa19daa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.288002 Aug 31 19:19:31.214962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 159/313] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:30 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:31.235052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:31.235665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:31.239689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:31.244370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:31.247467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:31.247467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:31.247467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:31.247467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:31.247992 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:31.451481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:31.459833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-19703b4d-9552-4548-83cf-2733e1fb34d8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.228575 Aug 31 19:19:31.460394 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 155/314] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:31 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:31.951872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:31.952696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:31.962955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:31.963886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:31.964764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:31.966021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:31.967045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:31.971746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.238618 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:32.240014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:32.247438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:32.248220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:32.249218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.250568 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:32.251149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:32.251690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.354626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:32.363881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1002ec20-b6c3-4bf3-bd0b-c3226f227136 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.416508 Aug 31 19:19:32.376782 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 160/315] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:31 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:32.481674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:32.482583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:32.488659 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:32.489351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:32.489887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.490695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:32.491250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:32.491784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:32.845607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:32.860616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-db65030e-505b-4580-84c2-d9c5d8a05204 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.627767 Aug 31 19:19:32.861281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 156/316] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:32 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:33.114810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:33.132594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2e0c51f-7f3b-4d02-bc90-0bcb9bcb2d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.655020 Aug 31 19:19:33.137425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 161/317] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:32 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:33.222468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-e8d07cb7-be78-4009-a1c2-ad4761670c2b req-a16cc252-74b7-4149-9d5b-12859d5a7583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5331a3a-ab47-460e-8240-dcfb15ae5912", "tag": "4bd7e60d-e0f4-4467-a5de-5aec33218ee1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:33.232941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e8d07cb7-be78-4009-a1c2-ad4761670c2b req-a16cc252-74b7-4149-9d5b-12859d5a7583 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.233789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e8d07cb7-be78-4009-a1c2-ad4761670c2b req-a16cc252-74b7-4149-9d5b-12859d5a7583 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.234436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e8d07cb7-be78-4009-a1c2-ad4761670c2b req-a16cc252-74b7-4149-9d5b-12859d5a7583 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:33.251074 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-e8d07cb7-be78-4009-a1c2-ad4761670c2b req-a16cc252-74b7-4149-9d5b-12859d5a7583 service nova] Creating event network-changed:4bd7e60d-e0f4-4467-a5de-5aec33218ee1 for instance b5331a3a-ab47-460e-8240-dcfb15ae5912 on hv-cinder-85221 Aug 31 19:19:33.259780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-e8d07cb7-be78-4009-a1c2-ad4761670c2b req-a16cc252-74b7-4149-9d5b-12859d5a7583 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041584 Aug 31 19:19:33.260748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 157/318] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:33.386812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:33.387437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:33.395152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.395684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.396122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:33.396867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.397323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.397777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:33.614034 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:33.618356 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:33.625901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c7e4757f-b22d-4708-8ce6-c7c80e44a646 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.243632 Aug 31 19:19:33.628437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 162/319] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:33 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:33.890656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:33.891828 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:33.902755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.903244 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.903681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:33.904750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:33.905522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:33.906109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.134448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:34.143830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cf67d691-6acb-4294-9b26-7c4e9a46633b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.262150 Aug 31 19:19:34.145191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 158/320] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:33 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:34.159765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:34.159765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:34.160363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:34.161077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:34.161927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:34.164142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:34.164671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:34.165078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.165781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:34.166213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:34.166702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.388304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:34.397891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bddbd130-62c6-4d20-97ab-d1874f74cca8 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.247207 Aug 31 19:19:34.398473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 163/321] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:34 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:34.653465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:34.654682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:34.664114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:34.664626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:34.665272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.666000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:34.666484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:34.666884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:34.847764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:34.863385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d6a1356-54fa-4a25-afe2-b7f21142eba8 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.210241 Aug 31 19:19:34.863385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 159/322] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:34 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:35.165679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:35.166282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:35.172540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.173217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.173655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.174524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.174983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.175412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.312713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:35.320898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6b646bcf-4701-4a21-8252-e4369cee80dc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.159282 Aug 31 19:19:35.321386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 164/323] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:35 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:35.419330 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:35.419932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:35.421908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:35.428335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.428842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.429277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.429972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.430419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.430839 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.506571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=10 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:35.571962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:35.579822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-934ae0cb-10b4-4f6c-8d6b-3b0bd649b341 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.164356 Aug 31 19:19:35.580938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 160/324] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:35 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:35.878600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:35.879221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:35.885483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.885980 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.886424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:35.887127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:35.887574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:35.887997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:36.045038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:36.055264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bc77cd3a-edb8-42d0-ac2b-094edd4a4aa5 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.180842 Aug 31 19:19:36.056069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 165/325] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:35 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:36.341909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:36.342535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:36.349378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:36.349791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:36.350223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:36.350913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:36.351362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:36.351786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:36.487310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:36.495034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2484dd52-05cf-4df7-a0e3-ecdd066010de tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.156964 Aug 31 19:19:36.495607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 161/326] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:36 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:36.603403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:36.604206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:36.610705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:36.611187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:36.612206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:36.612937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:36.613386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:36.613807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:36.767448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:36.775282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c44b565d-4593-4fa0-912e-eea6bf41dcc6 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.177927 Aug 31 19:19:36.775845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 166/327] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:36 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:37.077416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:37.078029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:37.085294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:37.085817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:37.086262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:37.086997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:37.087480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:37.087926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:37.232651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:37.240686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a7d86283-c34e-4ae5-9a59-2bc00679ea0e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.167138 Aug 31 19:19:37.241257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 162/328] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:37 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:37.516432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:37.517069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:37.524150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:37.524654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:37.525093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:37.525825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:37.526278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:37.526704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:37.661210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:37.669190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b16c88c9-a67d-4f8d-9216-f103c07c005a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.156597 Aug 31 19:19:37.669749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 167/329] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:37 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:37.796286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:37.796920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:37.804792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:37.805278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:37.805713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:37.806411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:37.806859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:37.807281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:37.947949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:37.957315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-48edb1ad-cba2-4158-b3a2-0ad3baf36532 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.164612 Aug 31 19:19:37.958039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 163/330] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:37 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:38.261507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:38.262119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:38.269373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.269856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.270293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.270997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.271448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.271875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.415317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:38.422842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6214c39d-32ce-43f9-b733-a3a851517899 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.165233 Aug 31 19:19:38.423397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 168/331] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:38 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:38.690692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:38.691481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:38.698689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.699167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.699597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.700290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.700771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.701196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.835580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:38.843906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d743c5e7-954c-4be3-848d-79348ce7a01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.158116 Aug 31 19:19:38.844487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 164/332] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:38 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:38.979815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:38.980460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:38.990408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.991190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.991821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:38.992778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:38.993480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:38.994186 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:39.151635 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:39.161518 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-41b3968b-5c1d-4c43-a2e1-01046d1dd5e9 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.186015 Aug 31 19:19:39.162101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 169/333] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:38 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:39.443804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.444826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:39.451607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:39.452087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:39.452520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:39.453240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:39.453686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:39.454582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:39.629382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:39.637720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f923360-cfe7-48ba-afa8-cb8a453531ab tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.197845 Aug 31 19:19:39.638496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 165/334] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:39.866863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.867465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:39.873401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:39.873870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:39.874293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:39.874975 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:39.875424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:39.876082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.021502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:40.029678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0035e8d3-2cd3-46d3-8f9f-d809278641ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.166654 Aug 31 19:19:40.030336 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 170/335] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:40.183004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:40.183641 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:40.190224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:40.190785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:40.191253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.191954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:40.192401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:40.192855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.324397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:40.333306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7cda7c0f-919c-4f8a-8a9d-6d8a31e243cd tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.154174 Aug 31 19:19:40.334104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 166/336] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:40 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:40.660157 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:40.660822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:40.667374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:40.667942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:40.668495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.669342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:40.669822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:40.670243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:40.813873 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:40.821725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-59df1c5e-7120-42ee-915b-ed3f507f4c4b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.166564 Aug 31 19:19:40.822535 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 171/337] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:40 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:41.052100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:41.052778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:41.061959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.062544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.066340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.067339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.067818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.068294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.073499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:41.225303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:41.233892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c28130a4-d01b-4961-b365-426d06aab01d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.186432 Aug 31 19:19:41.234812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 167/338] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:41 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:41.354051 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:41.354694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:41.360769 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.361250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.361722 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.362414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.362866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.363287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.530536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:41.539218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f7a8414d-11bf-4b57-a307-fca7fabc5233 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.189025 Aug 31 19:19:41.539794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 172/339] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:41 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:41.851942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:41.852655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:41.858768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.859463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.859950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:41.860685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:41.861138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:41.862237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.035825 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:42.045205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d888c7d-0281-46f2-af79-a114fe8c6eeb tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.197428 Aug 31 19:19:42.046335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 168/340] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:41 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:42.108684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-2141cc17-4379-4213-8f87-6762ba9d33a9 req-3cb77a7c-9b4b-4854-bec3-d4c733e9c0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5331a3a-ab47-460e-8240-dcfb15ae5912", "name": "network-vif-plugged", "status": "completed", "tag": "4bd7e60d-e0f4-4467-a5de-5aec33218ee1"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:42.120850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2141cc17-4379-4213-8f87-6762ba9d33a9 req-3cb77a7c-9b4b-4854-bec3-d4c733e9c0b1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.120850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2141cc17-4379-4213-8f87-6762ba9d33a9 req-3cb77a7c-9b4b-4854-bec3-d4c733e9c0b1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.120850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2141cc17-4379-4213-8f87-6762ba9d33a9 req-3cb77a7c-9b4b-4854-bec3-d4c733e9c0b1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.134161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-2141cc17-4379-4213-8f87-6762ba9d33a9 req-3cb77a7c-9b4b-4854-bec3-d4c733e9c0b1 service nova] Creating event network-vif-plugged:4bd7e60d-e0f4-4467-a5de-5aec33218ee1 for instance b5331a3a-ab47-460e-8240-dcfb15ae5912 on hv-cinder-85221 Aug 31 19:19:42.140342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-2141cc17-4379-4213-8f87-6762ba9d33a9 req-3cb77a7c-9b4b-4854-bec3-d4c733e9c0b1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Aug 31 19:19:42.141735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 173/341] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:42.256611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:42.257502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:42.269144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.270527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.271368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.272835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.273529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.274315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.427946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:42.435772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bf724ee4-4216-4335-812f-ce815124164b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.185003 Aug 31 19:19:42.436358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 169/342] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:42 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:42.562057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:42.562739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:42.569871 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.570349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.570834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.571746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:42.572196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:42.572792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:42.718872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:42.728506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-da78bf23-44bc-493f-bbd6-bafb385e1ca1 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.169895 Aug 31 19:19:42.729144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 174/343] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:42 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:43.069963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:43.070562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:43.077495 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.077974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.078561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.080662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.081272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.081856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.243754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:43.254313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-55fa44f2-6156-4538-ae39-e6bff1e1efe2 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.190819 Aug 31 19:19:43.256950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 170/344] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:43 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:43.457876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:43.458526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:43.464465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.464987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.465420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.466119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.466593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.467192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.749686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:43.750544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:43.758485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.758967 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.759402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.760106 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:43.760559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:43.761794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:43.807343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:43.816100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a030acd4-f0a1-49f3-b8ca-cb9ccd39b35d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.362649 Aug 31 19:19:43.816732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 175/345] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:43 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:43.920237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:43.930010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-80ec698a-2b5b-4b64-a3d1-605554291447 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1313 microversion: 2.1 time: 0.184407 Aug 31 19:19:43.930751 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 171/346] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:43 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:44.275712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:44.276645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:44.291463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.292345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.293190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.294747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.295572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.296376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.497141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:44.508969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4dc1ca30-a0c3-4563-9fce-e80ea6f4770e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.237697 Aug 31 19:19:44.509724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 176/347] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:44 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:44.546435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-1e36947f-7d80-4e3c-8d9b-d913ce242d50 req-2ec587f6-633e-4992-90d4-f1423db94cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "name": "network-vif-plugged", "status": "completed", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:44.563637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-1e36947f-7d80-4e3c-8d9b-d913ce242d50 req-2ec587f6-633e-4992-90d4-f1423db94cce service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.564117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-1e36947f-7d80-4e3c-8d9b-d913ce242d50 req-2ec587f6-633e-4992-90d4-f1423db94cce service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.565423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-1e36947f-7d80-4e3c-8d9b-d913ce242d50 req-2ec587f6-633e-4992-90d4-f1423db94cce service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.577891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-1e36947f-7d80-4e3c-8d9b-d913ce242d50 req-2ec587f6-633e-4992-90d4-f1423db94cce service nova] Creating event network-vif-plugged:facbf5d7-797a-4f5f-8a68-930bc7130258 for instance a83d3294-0902-4f21-a7b9-45b2b5229c52 on hv-cinder-85221 Aug 31 19:19:44.584120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-1e36947f-7d80-4e3c-8d9b-d913ce242d50 req-2ec587f6-633e-4992-90d4-f1423db94cce service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041239 Aug 31 19:19:44.585781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 172/348] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:44.840745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:44.848729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:44.860211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.860997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.861432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.863215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.864095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.864498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.952479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:44.953289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:44.959732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.960253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.960725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:44.961437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:44.961899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:44.962334 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:45.061131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:45.072031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f007cdba-339f-4f86-b021-cb2e620c8dfe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.237322 Aug 31 19:19:45.081474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 177/349] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:44 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:45.142825 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:45.152169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-359ff457-6ebc-4138-8dec-0314e2c6cc1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1496 microversion: 2.1 time: 0.204423 Aug 31 19:19:45.152912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 173/350] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:44 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1496 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:45.531015 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:45.531616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:45.539865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:45.540729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:45.541312 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:45.542395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:45.542854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:45.543261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:45.719103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:45.729573 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2ac529d6-4a90-4a01-90ab-502144a101df tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.202362 Aug 31 19:19:45.730155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 178/351] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:45 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:46.098398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:46.099093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:46.106178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:46.106691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.107127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.108121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:46.108611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.109221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.249280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:46.258552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4457dfe6-e2c2-42c4-80b9-b63fce30d1a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.165035 Aug 31 19:19:46.259214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 174/352] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:46 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:46.751598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:46.753304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:46.758991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:46.759467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.760528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.761692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:46.762297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:46.762866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:46.897983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:46.905714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2567d3c3-3ffc-49b4-81d8-36d2b99b784e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.157979 Aug 31 19:19:46.906290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 179/353] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:46 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:47.279344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:47.280008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:47.287300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.287779 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.288472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.289210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.289658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.290082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.430371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:47.438306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cc5c2313-f080-4f43-ad80-5ac4fa05c05a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.162765 Aug 31 19:19:47.438868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 175/354] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:47 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:47.927302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:47.927914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:47.933942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.934420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.934850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.935538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:47.935982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:47.936398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:47.941395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:48.080311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:48.088755 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3f1a0bc4-50fe-44d9-8d4a-8fe076fd064b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.165439 Aug 31 19:19:48.089173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 180/355] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:47 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:48.460588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:48.461307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:48.467667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.468173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.468690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.469312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:48.469795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:48.470176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:48.645017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:48.653016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-52290298-e78e-4d98-8879-687a2dc2f9c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.196515 Aug 31 19:19:48.653592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 176/356] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:48 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:49.112143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.113485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.119196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.119990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.120124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.120505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.120981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.121694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.122222 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.122699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.129287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.129775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.130399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.131480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.132093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.132517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.182470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:19:49.273849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-071f7d0d-6c2b-4371-9278-0180741da386 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "DELETE /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 204 len: 0 microversion: 2.1 time: 0.158247 Aug 31 19:19:49.274776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 177/357] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:19:49 2022] DELETE /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:19:49.283866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.284972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.291578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.292063 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.292491 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.293223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.293578 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:49.293747 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.294102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.302910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a686fe31-6f27-4f15-9507-56eb915c87fc tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.195246 Aug 31 19:19:49.303394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 181/358] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:49 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:49.441471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:49.449200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7553a10f-aa76-4ae3-bba3-226c7b664866 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1502 microversion: 2.1 time: 0.170034 Aug 31 19:19:49.449768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 178/359] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:49 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:49.674361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:49.675479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:49.681725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.682207 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.682641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.683337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:49.683819 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:49.684247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:49.823615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:49.832618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6e69d643-4aee-4425-a62e-01192f53870b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.162266 Aug 31 19:19:49.833188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 182/360] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:49 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:50.325473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:50.326080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:50.332965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.333463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.333898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.334589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.335038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.335464 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.470392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:50.472031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:50.473159 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:50.478626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.479239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.479751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.480518 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.481118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.481288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-844779bc-5c25-492e-8e75-c64b1941ad57 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.159391 Aug 31 19:19:50.481677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.481856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 179/361] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:50 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:50.623457 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:50.631393 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dd6061e9-c5ca-4516-8e2c-5df94086473d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1502 microversion: 2.1 time: 0.165429 Aug 31 19:19:50.631965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 183/362] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:50 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:50.853376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:50.854015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:50.860053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.860533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.861006 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:50.861998 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:50.862456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:50.862884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.001412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:51.010179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-255910c3-b93e-4e95-8d9c-261706fbc4f1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.160524 Aug 31 19:19:51.010757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 180/363] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:50 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:51.501858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:51.503114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:51.509941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.510593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.511022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.511718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.512162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.512607 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.655258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:51.655880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:51.664822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.665314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.665747 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.667031 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:51.667495 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:51.668037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:51.681856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:51.694229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4a0e5020-c751-488c-ba7d-9204cee1e543 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1259 microversion: 2.1 time: 0.193126 Aug 31 19:19:51.694229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 184/364] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:51 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:51.833138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:51.841145 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e31dd0d6-c38c-40c3-a076-49447b055a43 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1502 microversion: 2.1 time: 0.190302 Aug 31 19:19:51.841713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 181/365] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:51 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:52.032539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:52.033190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:52.040581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.041086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.041526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.042237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.042690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.043115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.200324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:52.209891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e379c38c-c112-4639-b2b4-5023827408cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.181258 Aug 31 19:19:52.210479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 185/366] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:52 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:52.718385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:52.719134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:52.729399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.729895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.730337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.731051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.731501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.731927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.865261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:52.867685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:52.872790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.873282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.874008 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.874978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.875588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.876189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.895433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:52.899164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:52.906102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-29539441-3eb8-457c-ae77-d558cba61ef3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1442 microversion: 2.1 time: 0.194945 Aug 31 19:19:52.906495 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 182/367] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:52 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1442 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:52.931781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:52.932371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:52.939575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.940710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.941336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:52.942054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:52.942531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:52.943594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.107520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:53.125692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e0b8e401-d702-46e8-8bd8-3fdcb9df9b82 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1502 microversion: 2.1 time: 0.260097 Aug 31 19:19:53.125692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 186/368] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:52 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:53.140752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:53.152191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3343f6e4-cc66-4ffc-aabf-5afbb0ea8117 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1442 microversion: 2.1 time: 0.225389 Aug 31 19:19:53.153541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 183/369] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:52 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1442 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:53.231435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:53.231950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:53.239336 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.239825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.240268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.241016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:53.241470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:53.241898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:53.461901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:53.473409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5f629b0b-d503-41c4-b3a6-4d76db46ab9c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.245794 Aug 31 19:19:53.474090 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 187/370] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:53 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:54.150837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:54.152436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:54.165711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.167700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.168334 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.169365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.170864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.171883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.359086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:54.369703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cdbccc36-da02-41c3-96c8-c9a0276fe60b tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1502 microversion: 2.1 time: 0.225852 Aug 31 19:19:54.385585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 184/371] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:54 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:54.497510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:54.505852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:54.508894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.509548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.510083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:54.511318 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:54.511842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:54.512544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.015291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:55.023801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ee6c0da1-acad-4a3b-ac00-52e294a57573 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.531702 Aug 31 19:19:55.040357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 188/372] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:54 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:55.391350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:55.391962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:55.410826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.411660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.412104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.413125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.413571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.414271 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.484426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-ea1cbb14-36cc-47be-8924-0bb2eafde2b1 req-6e05c4d4-316c-4d97-8702-ef417b31697b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5331a3a-ab47-460e-8240-dcfb15ae5912", "name": "network-vif-deleted", "tag": "4bd7e60d-e0f4-4467-a5de-5aec33218ee1"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:55.496330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ea1cbb14-36cc-47be-8924-0bb2eafde2b1 req-6e05c4d4-316c-4d97-8702-ef417b31697b service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.497014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ea1cbb14-36cc-47be-8924-0bb2eafde2b1 req-6e05c4d4-316c-4d97-8702-ef417b31697b service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.497542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ea1cbb14-36cc-47be-8924-0bb2eafde2b1 req-6e05c4d4-316c-4d97-8702-ef417b31697b service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.511349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-ea1cbb14-36cc-47be-8924-0bb2eafde2b1 req-6e05c4d4-316c-4d97-8702-ef417b31697b service nova] Creating event network-vif-deleted:4bd7e60d-e0f4-4467-a5de-5aec33218ee1 for instance b5331a3a-ab47-460e-8240-dcfb15ae5912 on hv-cinder-85221 Aug 31 19:19:55.519138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-ea1cbb14-36cc-47be-8924-0bb2eafde2b1 req-6e05c4d4-316c-4d97-8702-ef417b31697b service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037752 Aug 31 19:19:55.521285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 189/373] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:55.545306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:55.546388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-ef685634-e042-4d34-b8b1-76c42c9f0ee5 req-eecb696b-c879-4680-9780-a40313997575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:19:55.558963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ef685634-e042-4d34-b8b1-76c42c9f0ee5 req-eecb696b-c879-4680-9780-a40313997575 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:55.559507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ef685634-e042-4d34-b8b1-76c42c9f0ee5 req-eecb696b-c879-4680-9780-a40313997575 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:55.560089 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ef685634-e042-4d34-b8b1-76c42c9f0ee5 req-eecb696b-c879-4680-9780-a40313997575 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:55.566145 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fa1ea907-9b08-4771-9e4c-cdc87d1db3d7 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1460 microversion: 2.1 time: 0.178607 Aug 31 19:19:55.566727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 185/374] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:55 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1460 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:55.578093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-ef685634-e042-4d34-b8b1-76c42c9f0ee5 req-eecb696b-c879-4680-9780-a40313997575 service nova] Creating event network-changed:facbf5d7-797a-4f5f-8a68-930bc7130258 for instance a83d3294-0902-4f21-a7b9-45b2b5229c52 on hv-cinder-85221 Aug 31 19:19:55.583886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-ef685634-e042-4d34-b8b1-76c42c9f0ee5 req-eecb696b-c879-4680-9780-a40313997575 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041611 Aug 31 19:19:55.587883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 190/375] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:19:56.048277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:56.049133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:56.070554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.071049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.071488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.072320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.072986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.073381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.231937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:56.241516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b4ae7392-024d-4f51-ab61-fed4c6129070 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.197438 Aug 31 19:19:56.242291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 186/376] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:56 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:56.596392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:56.597463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:56.604020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.604749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.605364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.606129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:56.606747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:56.607171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:56.678397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:56.687981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a7293089-7b1e-40c0-ab36-62291b8af9d0 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1298 microversion: 2.1 time: 0.099184 Aug 31 19:19:56.688909 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 191/377] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:56 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:57.263571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:57.264186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:57.273288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.273288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.273780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.274691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.275262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.275771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.422313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:57.431316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-812f024e-d998-4086-a6ad-1a899623a895 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.171533 Aug 31 19:19:57.432060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 187/378] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:57 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:57.711595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:57.712141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:57.718466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.719111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.719539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.720312 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:57.721358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:57.721928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:57.787345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:57.795484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ff6a2a33-0a76-4992-9ec8-fd648f50bebc tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1298 microversion: 2.1 time: 0.088090 Aug 31 19:19:57.796374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 192/379] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:57 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:58.452186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:58.452926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:58.460750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.460750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.461034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.461731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.462352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.462790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.616723 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:58.625655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af6cc5de-381b-4f57-9018-2d07c1a1647e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.177207 Aug 31 19:19:58.626238 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 188/380] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:58 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:58.817856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:58.818497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:58.824703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.825182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.825615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.826314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:58.826768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:58.827191 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:58.896662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:58.904242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a5d7b0f9-a78c-477a-a5d4-ac0eccd37851 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1298 microversion: 2.1 time: 0.090815 Aug 31 19:19:58.904843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 193/381] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:58 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:59.650429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:59.651204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:59.657864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.658892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.659589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.660393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.660899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.661363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.806560 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:19:59.814239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f23f5e46-817a-46aa-a759-c6226b90e452 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.168023 Aug 31 19:19:59.817263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 189/382] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:59 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:59.928250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:59.928903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:19:59.935331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.936044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.936474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.937215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.937663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.938266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.970154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:19:59.971243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:19:59.971743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:19:59.972536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lazy-loading 'fault' on Instance uuid b5331a3a-ab47-460e-8240-dcfb15ae5912 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:20:00.023143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c7e84a2809475cb7fbfaf905c2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b4c76757374438b8d4b0b7148be568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:00.031367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6aba0541-22ee-4f40-b3d3-e2ab33fa4c13 tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 200 len: 1303 microversion: 2.1 time: 0.108524 Aug 31 19:20:00.032150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 194/383] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:19:59 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:00.843438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:00.844053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:00.854951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:00.855438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:00.855874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:00.856625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:00.857049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:00.857471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.021168 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:01.030764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-664ee77e-f8a4-4714-9ee4-bf0dec88c848 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1521 microversion: 2.1 time: 0.199226 Aug 31 19:20:01.031653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 190/384] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:00 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:01.055322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:01.056188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] [instance: b5331a3a-ab47-460e-8240-dcfb15ae5912] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:01.062932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.063857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.064200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.065421 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:01.065961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:01.066463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:01.083621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] HTTP exception thrown: Instance b5331a3a-ab47-460e-8240-dcfb15ae5912 could not be found. Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Request method failure captured: Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 HTTP/1.1 Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7QcMQ3N4BLNhsqo7P4V-Qq--3fnNIa8SJQ6DUH2OGacWGBb0py8m3hRsn2YjJfTsRPufYnwSNSPLz5opDNVb9drjTrNT5kjxvyznU20abSk_Ot-G9IxOlM1QIMiT4b_8p3SZP8ka6MnqB72ZMU7j80LEjuDm33Ol3LrKFnX4awoy9A Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 47b4c76757374438b8d4b0b7148be568 Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-VolumesActionsTest-182393730 Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:20:01.085400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/47b4c76757374438b8d4b0b7148be568"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/47b4c76757374438b8d4b0b7148be568"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_47b4c76757374438b8d4b0b7148be568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/47b4c76757374438b8d4b0b7148be568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-VolumesActionsTest-182393730 Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 47b4c76757374438b8d4b0b7148be568 Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-VolumesActionsTest-182393730 Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-VolumesActionsTest-182393730-project Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: b7c7e84a2809475cb7fbfaf905c2ad5c Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-VolumesActionsTest-182393730-project Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance b5331a3a-ab47-460e-8240-dcfb15ae5912 could not be found. Aug 31 19:20:01.086926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'b5331a3a-ab47-460e-8240-dcfb15ae5912'} Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5331a3a-ab47-460e-8240-dcfb15ae5912 could not be found. Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:20:01.087766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5331a3a-ab47-460e-8240-dcfb15ae5912 could not be found. Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5331a3a-ab47-460e-8240-dcfb15ae5912 could not be found. Aug 31 19:20:01.089230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:01.090460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] Returning 404 to user: Instance b5331a3a-ab47-460e-8240-dcfb15ae5912 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:20:01.090460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9df69549-9dd0-4ce6-9ba9-1b3954ee9d1d tempest-VolumesActionsTest-182393730 tempest-VolumesActionsTest-182393730-project] 10.222.0.95 "GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912" status: 404 len: 111 microversion: 2.1 time: 0.036388 Aug 31 19:20:01.090460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 195/385] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:01 2022] GET /compute/v2.1/servers/b5331a3a-ab47-460e-8240-dcfb15ae5912 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:20:02.053368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:02.065190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:02.065190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:02.065190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.065190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.065630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.065630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.065630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.065630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.206743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:02.214970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4092ca3e-d48f-4c8f-b4c3-7ff3f073861f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1501 microversion: 2.1 time: 0.165326 Aug 31 19:20:02.215545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 191/386] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:02 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:02.235851 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:02.236731 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:02.242768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.243242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.243668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.244380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:02.245032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:02.245455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:02.384949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:02.393540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-508bf41a-d140-43e8-a6ab-b2692650640e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1515 microversion: 2.1 time: 0.161604 Aug 31 19:20:02.394326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 196/387] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:02 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:06.602000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:06.602547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:06.609029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:06.609538 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:06.609969 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:06.610684 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:06.612149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:06.612599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:06.635483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-035565c2-514e-442d-9381-d87ce82652ed tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/ips" status: 200 len: 150 microversion: 2.20 time: 0.037359 Aug 31 19:20:06.636041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 192/388] 10.222.0.95 () {60 vars in 1289 bytes} [Wed Aug 31 19:20:06 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:20:06.971184 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:06.973295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:06.975473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=70 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:06.981893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:06.982371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:06.982800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:06.983493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:06.983979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:06.984485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:07.007809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'flavor' on Instance uuid d7220888-b7b3-4d53-80fd-85596b3370cb {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:20:07.032222 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:07.087993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0d20fd70-7b43-4d6b-ae5a-dbadddefeec5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/action" status: 200 len: 32 microversion: 2.1 time: 0.121414 Aug 31 19:20:07.088610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 197/389] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:20:06 2022] POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/action => generated 32 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:20:07.098341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:07.099051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:07.105012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:07.105572 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:07.106015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:07.106717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:07.107177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:07.107604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:07.296822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:07.307481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-02a3100a-bc67-4939-aee4-ed13d2996ed4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.213177 Aug 31 19:20:07.308139 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 193/390] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:07 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:08.330643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:08.331707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:08.338719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.339350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.339784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.340557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:08.341208 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:08.341637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:08.500924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:08.509844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a10cfbc2-c5ee-443b-85df-b89819fd88c7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.184159 Aug 31 19:20:08.510389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 198/391] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:08 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:09.530100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:09.530793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:09.539629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:09.540104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:09.540529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:09.541250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:09.541699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:09.542117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:09.679743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:09.688501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6f9d0291-0770-4cb1-9ab9-8877969a1a50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.162388 Aug 31 19:20:09.689549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 194/392] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:09 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:10.577410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:10.578018 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:10.584091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.584602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.585032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.585746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.586200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.586616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.609586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'flavor' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:20:10.710739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:10.711472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:10.723869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.724402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.729571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.730445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.731069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.731790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.768726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2861e58d-56dc-458a-b49d-690ad2a4d0d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/ips" status: 200 len: 149 microversion: 2.1 time: 0.062761 Aug 31 19:20:10.778572 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 195/393] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:20:10 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:10.784047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:10.784958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:10.792481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.793341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.794059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.795458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.796253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.796909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.859459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e7194c87-c4b4-4af1-9d10-7dd332a0f954 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/action" status: 202 len: 0 microversion: 2.20 time: 0.285739 Aug 31 19:20:10.861478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 199/394] 10.222.0.95 () {62 vars in 1319 bytes} [Wed Aug 31 19:20:10 2022] POST /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:20:10.877288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:10.879053 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:10.890221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.891139 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.891972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.894167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:10.894771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:10.895404 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:10.994995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:11.004831 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3fbc40e9-2c36-4b45-8b1f-70f1bbae0eba tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.224877 Aug 31 19:20:11.021002 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 196/395] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:10 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:11.113985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:11.122887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:11.124804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:11.127332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5bc67205-f7d5-4598-8678-50e9f26affcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.259524 Aug 31 19:20:11.128994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 200/396] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:10 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:12.029833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:12.029833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:12.036274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.036794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.037233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.038314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.038642 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.039064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.154322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:12.154947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:12.163404 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.164542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.165424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.166550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.167330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.167974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.205967 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:12.215740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1e37da23-0500-424d-8570-f580fc231643 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.190316 Aug 31 19:20:12.216794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 197/397] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:12 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:12.317242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:12.325311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:12.326732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:12.327876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-551a94c3-f30e-470a-970c-22923ae31767 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.177770 Aug 31 19:20:12.328420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 201/398] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:12 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:12.490041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5aebc5a-fd02-4940-a5c5-38c80c37287e"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:12.492516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:12.498546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.499033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.499472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.500170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:12.500672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:12.501102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:12.929114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:12.953165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-36086442-ce8f-4727-8cd8-f8ea4ccdd23c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466601 Aug 31 19:20:12.965805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 198/399] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:20:12 2022] POST /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 194 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:13.242238 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:13.244092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:13.269447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.270327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.271278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.272190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.272861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.273652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.353833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:13.354945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:13.372489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.372489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.372489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.372489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:13.372845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:13.372845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:13.547623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:13.555435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a8a19308-37f3-47e5-8d7c-ce286eb5e00b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.321100 Aug 31 19:20:13.556002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 202/400] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:13 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:13.575440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:13.584907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:13.586389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:13.587675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c849b984-10dd-41c7-8487-b922171d3e21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.239555 Aug 31 19:20:13.588223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 199/401] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:13 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:14.577021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:14.577822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:14.584317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:14.584828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:14.585268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:14.585954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:14.586402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:14.586822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:14.610813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:14.612317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:14.619294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:14.619785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:14.620333 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:14.621086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:14.621531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:14.621956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:14.777262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:14.785707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b98fdfa-b43f-4c94-a462-36a61c70ba58 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.212550 Aug 31 19:20:14.786310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 203/402] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:14 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:14.804861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:14.814308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:14.819541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:14.820891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3efddafa-9850-4670-91ad-4162325b65ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.213978 Aug 31 19:20:14.821683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 200/403] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:14 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:15.810449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:15.811083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:15.826001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:15.827434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:15.828090 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:15.829048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:15.829828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:15.830529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:15.858582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:15.859204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:15.874405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:15.874903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:15.875722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:15.876916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:15.877379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:15.878124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:16.036306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:16.044301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9dc049e3-7871-470e-83c9-39345e7d48e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.240447 Aug 31 19:20:16.045123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 204/404] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:15 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:16.065657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:16.074008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:16.075544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:16.076739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4963bf45-86b2-4f89-be03-6e25aa131dc7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.223915 Aug 31 19:20:16.077291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 201/405] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:15 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:17.067531 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:17.068586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:17.074652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.075135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.075569 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.076320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.076803 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.077226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.103144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:17.104482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:17.112703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.113774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.114518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.115505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.116343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.117038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.309472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:17.321427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-13e18838-2191-4a88-a785-27ea062b77c2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.258201 Aug 31 19:20:17.335887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 205/406] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:17 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:17.357869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:17.366715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:17.368172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:17.369392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-881e9951-09f6-4bc8-b8fc-687fb7e3ac68 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.272565 Aug 31 19:20:17.369963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 202/407] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:17 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:17.808295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:17.808816 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:17.815522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.816035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.816471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.817193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:17.817645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:17.818069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:17.842541 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e0c9946f-f8d3-469a-8349-9bf73db86ac5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/ips" status: 200 len: 145 microversion: 2.1 time: 0.038093 Aug 31 19:20:17.843106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 206/408] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:20:17 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:18.356312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:18.357379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:18.384162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:18.384988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:18.385818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:18.389334 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:18.390458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:18.391733 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:18.407997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:18.412745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:18.465783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:18.468870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:18.472874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:18.474003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:18.474583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:18.475117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:18.742924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:18.757295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:18.762963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0f3131c3-3f10-4769-a7a7-198ac30e5073 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.420630 Aug 31 19:20:18.763547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 203/409] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:18 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:18.768651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:18.770819 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:18.773409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-db72bc4c-1279-42f2-9e21-54149e588059 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.380480 Aug 31 19:20:18.773409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 207/410] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:18 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:19.786158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:19.786758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:19.804847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:19.804962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:19.805470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:19.805470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:19.805677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:19.805774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:19.805774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:19.805774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:19.806022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:19.806261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:19.806944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:19.807876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:19.808595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:19.809469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:20.033970 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:20.037670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:20.049635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fa1a2206-6fda-49df-b52b-735cb7357753 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.265078 Aug 31 19:20:20.049795 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:20.050235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 204/411] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:19 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:20.051107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:20.052282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-11bdaaeb-bdca-4859-a1b1-e99856ae3292 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.258925 Aug 31 19:20:20.053325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 208/412] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:19 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:21.070513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:21.071080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:21.076353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:21.076993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:21.077482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:21.077968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:21.078416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:21.079108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:21.079607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:21.080070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:21.083328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:21.083971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:21.084753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:21.086092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:21.086903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:21.087758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:21.293995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:21.297113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:21.303283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-acb5a681-2424-4ccd-9002-dfbc7e28e824 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.236732 Aug 31 19:20:21.303982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 205/413] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:21 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:21.305664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:21.307120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:21.308269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f6e3d9f6-7ba5-4b40-a881-81d13e712bd2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.235813 Aug 31 19:20:21.308951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 209/414] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:21 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:22.007237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47f1b32-5fe3-45a7-8add-004caa8b111f"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:22.010128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:22.024664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:22.026390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:22.029164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:22.031325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:22.032087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:22.033923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:22.328891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:22.330281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:22.342208 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:22.348309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:22.348954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:22.349801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:22.350355 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:22.351100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:22.569775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-48ac230f-b35e-4bae-87aa-24415952653c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566341 Aug 31 19:20:22.570453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 206/415] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:20:22 2022] POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-volume_attachments => generated 194 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:22.578399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:22.579781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:22.609461 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:22.618133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:22.619619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:22.620610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:22.621259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:22.621738 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:23.026718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:23.042372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:23.043967 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:23.045284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d66a54c-91c1-4a8f-9d00-d04096cfa76d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.472923 Aug 31 19:20:23.045959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 207/416] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:22 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:23.077862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-91ffd546-ccb2-485a-bc01-87f594c09c2c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: .version_select at 0x7f975fbd14c0>, body: {"keypair": {"name": "tempest-keypair-912282704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKl2xtTX15fIJJzYAUBQRu9NUiSpWlVuLpT8EbJKDodFX+daX5lep7jOJURcT7lyMxao5mr46PvVVpWMUMjHqnPqfIsXP05nSKyisDiWHhwMoeGKIlYuA2/Qbt7HO2nJAg=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:23.097725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-91ffd546-ccb2-485a-bc01-87f594c09c2c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:20:23.105519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-91ffd546-ccb2-485a-bc01-87f594c09c2c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:20:23.105918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:23.118247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-010e2522-a64c-4239-82d9-327ea7e7ef52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.796474 Aug 31 19:20:23.118719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 210/417] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:22 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:23.138649 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-91ffd546-ccb2-485a-bc01-87f594c09c2c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068936 Aug 31 19:20:23.139405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 208/418] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:20:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:24.083163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:24.084671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:24.092070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:24.093178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:24.093321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:24.094273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:24.095451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:24.096089 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:24.129371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:24.153523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:24.154124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:24.164982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:24.165950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:24.166628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:24.167555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:24.168167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:24.168778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:24.352822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:24.368102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:24.379894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:24.394023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2b03b751-8ee8-4d3b-ac14-dbff5e98e308 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.315159 Aug 31 19:20:24.399213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 211/419] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:24 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:24.406052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:24.424688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f6fe42a-b539-4f6d-8edc-14a8d4c75b05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.286837 Aug 31 19:20:24.438680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 209/420] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:24 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:25.159950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2095190732", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65051338-00b4-459c-8f05-d190e2d29e4b"}], "security_groups": [{"name": "tempest-securitygroup--1525004668"}], "key_name": "tempest-keypair-912282704", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:25.429294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:25.430963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:25.438395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:25.439708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:25.440648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:25.441470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:25.452204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:25.460620 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:25.658170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:25.672488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:25.675052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:25.676599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-91c19d84-32eb-4b30-b78b-1f00642c6bff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.252699 Aug 31 19:20:25.677882 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 210/421] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:25 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:25.692797 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:25.694292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:25.711019 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:25.712626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:25.713591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:25.715770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:25.717113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:25.718188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:25.948758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:25.979670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-beb9d7ac-4653-43af-bc11-3d2b0f5295d3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.300236 Aug 31 19:20:25.980725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 211/422] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:25 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:26.711518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:26.712422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:26.723758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:26.725164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:26.726456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:26.727611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:26.728247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:26.728857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:26.979766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:26.990620 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:26.992387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:26.994661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ba8bc259-4d10-478d-91db-721ec62932cf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.288128 Aug 31 19:20:26.995548 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 212/423] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:26 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:27.006084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:27.006688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:27.012835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:27.013340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:27.013773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:27.014449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:27.014896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:27.015343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:27.153428 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:27.161377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2422ee51-5605-4954-a1be-9cf81695d314 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.159313 Aug 31 19:20:27.161939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 213/424] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:27 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:28.025689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:28.026393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:28.038947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:28.039626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:28.040705 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:28.042359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:28.043595 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:28.044361 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:28.234891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:28.243350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:28.244835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:28.245994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-899973f1-0eb8-49cb-b66a-2a5090a4a43c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.230979 Aug 31 19:20:28.246545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 214/425] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:28 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:28.253351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:28.254047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:28.261708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:28.262585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:28.263021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:28.263784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:28.265034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:28.265628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:28.271064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:28.414874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:28.423526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-645bd524-7a8b-4e37-9e3c-564020ab034c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.173384 Aug 31 19:20:28.424199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 215/426] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:28 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:29.271678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:29.272352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:29.278768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:29.279247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:29.279688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:29.280664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:29.281096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:29.281537 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:29.526570 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:29.543255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:29.545285 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:29.546516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2d5a7241-44a0-458d-a140-774d4fada604 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.280636 Aug 31 19:20:29.547087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 216/427] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:29 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:29.593566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:29.598172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:29.604670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:29.605168 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:29.605604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:29.606316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:29.606772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:29.607203 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:29.771643 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:29.779801 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-127ed58a-8739-4906-aa69-bdb5fd21abe7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.231676 Aug 31 19:20:29.780431 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 217/428] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:29 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:30.598829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:30.599591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:30.606764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:30.607393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:30.607823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:30.608561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:30.609203 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:30.609618 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:30.759571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:30.769185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:30.770803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:30.771993 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cce1f7d1-23a6-46cc-89f6-f0786e988b48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.177835 Aug 31 19:20:30.772894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 218/429] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:30 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:30.801962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:30.802575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:30.808489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:30.808995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:30.809428 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:30.810112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:30.810616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:30.811252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:30.966337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:30.977001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5b467ce2-7d68-459e-9876-2fc3ab84b33b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.178921 Aug 31 19:20:30.977616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 219/430] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:30 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:31.796331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:31.797897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:31.804851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:31.805331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:31.805764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:31.806458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:31.806917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:31.807366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:31.972827 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:31.992498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:31.994755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:31.996402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ad985cd3-f0dd-4f3d-8cf9-017786964238 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.203890 Aug 31 19:20:32.016050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 220/431] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:31 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:32.022324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:32.023116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:32.030498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:32.031131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:32.031865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:32.033181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:32.033711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:32.034258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:32.180598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:32.190367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ed17b93-3971-4c52-9aa6-c6666592d018 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.172322 Aug 31 19:20:32.191007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 221/432] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:32 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:33.024156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:33.025237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:33.027155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:33.032892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:33.033470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:33.033982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:33.034760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:33.035302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:33.035733 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:33.117016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=4 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:33.185501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:33.196448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:33.197941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:33.199209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9a6e8290-ea57-4e08-afa3-9933e046b5ff tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.178806 Aug 31 19:20:33.199665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 222/433] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:33 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:33.220067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:33.221592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:33.231552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:33.232923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:33.234178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:33.236598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:33.237448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:33.238208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:33.445768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:33.456118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e086873d-c203-4b91-a0a9-8a3bbc2c431c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.244602 Aug 31 19:20:33.460828 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 223/434] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:33 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:34.237602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:34.238379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:34.244758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:34.245239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:34.245683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:34.246380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:34.246832 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:34.247260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:34.357822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:34.393960 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:34.402198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:34.403650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:34.404924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2dd8e842-9036-4ef5-a95e-5b30f1f87298 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.172075 Aug 31 19:20:34.405666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 224/435] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:34 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:34.477320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:34.478266 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:34.484293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:34.484805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:34.487651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:34.488557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:34.489107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:34.489537 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:34.644784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:34.660753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4db153f4-3285-4a88-901b-b83cc78d1b4d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.187157 Aug 31 19:20:34.661654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 225/436] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:34 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:35.176738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=31 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:35.431554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:35.432154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:35.442613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:35.443268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:35.444022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:35.444784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:35.445335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:35.445674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:35.661117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:35.693851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:35.696036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:35.698037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8fc021f0-590b-4288-86d3-7f45b13c1c9f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.270803 Aug 31 19:20:35.699293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 226/437] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:35 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:35.709458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:35.711366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:35.720900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:35.721405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:35.722040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:35.723179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:35.733943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:35.735728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:35.967913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:36.025962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8f83ab71-6ee5-4f67-87e5-b9a445bb5cfa tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.322960 Aug 31 19:20:36.026799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 227/438] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:35 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:36.733344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:36.734092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:36.740732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:36.741214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:36.741650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:36.742357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:36.742812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:36.743233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:36.899557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:36.908757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:36.910239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:36.911439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c1bb6a9c-b316-41fe-9dbe-8a50dc645ad9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.182259 Aug 31 19:20:36.912483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 228/439] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:36 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:36.917165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-df0d72f2-93b2-490d-94d8-b0e63a09f792 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:36.924545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-df0d72f2-93b2-490d-94d8-b0e63a09f792 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:36.925060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-df0d72f2-93b2-490d-94d8-b0e63a09f792 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:36.925499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-df0d72f2-93b2-490d-94d8-b0e63a09f792 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:36.991303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-df0d72f2-93b2-490d-94d8-b0e63a09f792 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Going to try to stop instance {{(pid=120706) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 19:20:37.044678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-df0d72f2-93b2-490d-94d8-b0e63a09f792 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action" status: 202 len: 0 microversion: 2.1 time: 0.130721 Aug 31 19:20:37.045378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 229/440] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:20:36 2022] POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:20:37.054193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:37.054864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:37.062057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:37.062057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:37.062549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:37.062928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:37.063986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:37.064508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:37.219287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:37.225181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:37.230357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8e1a11b7-2310-4a64-b518-a156c80d7b34 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.180568 Aug 31 19:20:37.231118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 230/441] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:37 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:37.236962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:37.237769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:37.244202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:37.244947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:37.245656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:37.246531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:37.247177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:37.247608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:37.393912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:37.404217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-48c4f579-a78e-4aef-864e-c3616e55eb92 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.171426 Aug 31 19:20:37.404895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 231/442] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:37 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:37.939812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:37.940881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:37.948885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:37.950378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:37.950941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:37.951852 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:37.952316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:37.953018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:38.114051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:38.123558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:38.125403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:38.127895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c5bcdebf-b273-40e2-9989-51117d845641 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.194094 Aug 31 19:20:38.128309 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 232/443] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:37 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:38.255513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:38.256360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:38.263219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:38.263810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:38.264390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:38.265213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:38.265762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:38.266847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:38.401294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:38.410611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-044ffd61-eedb-44e5-85e1-54b38d463bc5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.159761 Aug 31 19:20:38.411188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 233/444] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:38 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:38.427872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:38.428486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:38.437747 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:38.438768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:38.439234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:38.439928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:38.440376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:38.440834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:38.575182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:38.585109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7a69784a-d2d8-4af6-93a5-c62727b0eb32 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.161483 Aug 31 19:20:38.585672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 234/445] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:38 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:39.151487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:39.152189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:39.159315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.159791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.160257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.161018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.161589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.162259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.306205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:39.322610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:39.325991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:39.328298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-09adb846-fea8-4208-8af7-46220499868b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1741 microversion: 2.20 time: 0.180873 Aug 31 19:20:39.330023 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 235/446] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:39 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:39.441762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:39.442823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:39.452790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.454992 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.456302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.457718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.458645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.459520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.701037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:39.712147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3e4f57df-c66c-404d-ab07-e2f1be08d82a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.282522 Aug 31 19:20:39.713118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 236/447] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:39 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:39.721713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-431eb3cb-589d-4312-be9a-615a9e92d4d1 req-072cf80a-037e-4c77-b53b-8d29a49093d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "name": "network-vif-plugged", "status": "completed", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:39.740978 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-431eb3cb-589d-4312-be9a-615a9e92d4d1 req-072cf80a-037e-4c77-b53b-8d29a49093d2 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.741587 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-431eb3cb-589d-4312-be9a-615a9e92d4d1 req-072cf80a-037e-4c77-b53b-8d29a49093d2 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.742125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-431eb3cb-589d-4312-be9a-615a9e92d4d1 req-072cf80a-037e-4c77-b53b-8d29a49093d2 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.754302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-431eb3cb-589d-4312-be9a-615a9e92d4d1 req-072cf80a-037e-4c77-b53b-8d29a49093d2 service nova] Creating event network-vif-plugged:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:20:39.759145 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-431eb3cb-589d-4312-be9a-615a9e92d4d1 req-072cf80a-037e-4c77-b53b-8d29a49093d2 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044560 Aug 31 19:20:39.760042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 237/448] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:20:39.765097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:39.765792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:39.772362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.772875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.773308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.773999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:39.774443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:39.774860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:39.932849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:39.943068 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-04eb5a42-71dc-45b7-b3e4-8ea8fd2aa895 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.181797 Aug 31 19:20:39.944602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 238/449] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:39 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:40.358126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:40.358781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:40.366170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:40.366669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:40.367086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:40.367780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:40.368230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:40.368866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:40.505914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:40.514125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:40.515557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:40.517485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d553d8e-b3db-4159-a4c8-34d1834cc588 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.163178 Aug 31 19:20:40.517915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 239/450] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:40 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:40.747262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:40.747899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:40.755425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:40.755912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:40.756348 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:40.757222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:40.758323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:40.758323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:40.907699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:40.917929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9df06c7d-4139-45f6-ab24-ba5e124e6aff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.174462 Aug 31 19:20:40.918826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 240/451] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:40 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:40.967903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:40.968589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:40.975516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:40.975994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:40.976427 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:40.977234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:40.977677 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:40.978181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:41.143654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:41.151967 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a58453f8-886a-49cd-8fba-ec3cea439b76 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.187917 Aug 31 19:20:41.152525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 241/452] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:40 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:41.541341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:41.542124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:41.549240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:41.549715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:41.550173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:41.550858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:41.551373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:41.551927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:41.697536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:41.707918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:41.710057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:41.711236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b3801950-6803-45bf-889a-a079cef35103 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.174181 Aug 31 19:20:41.712013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 242/453] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:41 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:41.943580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:41.944109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:41.950493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:41.951015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:41.951470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:41.952213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:41.952656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:41.953085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:42.126459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:42.147829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-14c2ad62-a944-46cb-bad6-3c71ee65a920 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.209789 Aug 31 19:20:42.148430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 243/454] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:41 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:42.174260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:42.182881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:42.183895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:42.184248 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:42.185473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:42.186071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:42.186788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:42.186952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:42.362908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:42.372320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dda388ce-6afa-4470-a936-e37815b27ed5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.202696 Aug 31 19:20:42.373455 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 244/455] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:42 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:42.734111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:42.734821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:42.741428 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:42.741904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:42.742337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:42.743025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:42.743473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:42.743892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:42.885898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:42.895472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:42.896934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:42.898111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2aa33558-25b6-4fe1-b31e-25ce67ee69a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.167903 Aug 31 19:20:42.898660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 245/456] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:42 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:43.169434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:43.170051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:43.176489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.177636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.178101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.178798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.179251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.179675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.321944 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:43.330996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e54ac286-8b5c-4486-b293-ab01bca18cc0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.165698 Aug 31 19:20:43.340770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 246/457] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:43 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:43.398749 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:43.399274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:43.405321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.406185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.406663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.407389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.407848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.408284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.561473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:43.572440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9cb86ee1-93d7-40a9-ae23-2e27b6403015 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.177332 Aug 31 19:20:43.573405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 247/458] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:43 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:43.921228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:43.921872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:43.928794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.929299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.929727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.930413 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:43.930858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:43.931273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:43.935576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:44.094044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:44.104143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:44.106178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:44.107551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-172c30d0-beb9-4a14-9f5f-d03e37ea130f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.190271 Aug 31 19:20:44.108296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 248/459] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:43 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:20:44.354057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:44.354674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:44.363647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.364185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.364654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.365402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.365862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.366333 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.510894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:44.519920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3539bc62-a252-44bb-901b-66ad2c976350 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.170220 Aug 31 19:20:44.520452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 249/460] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:44 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:44.596447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:44.597098 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:44.604552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.605142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.605574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.606477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:44.606942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:44.607344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:44.758030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:44.769002 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0cc07992-117c-4cab-96d9-433f32e08afe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.178171 Aug 31 19:20:44.776035 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 250/461] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:44 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:45.135214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:45.135972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:45.147215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:45.147712 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:45.148153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:45.148985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:45.149456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:45.150021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:45.354420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:45.370532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:45.374030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:45.376496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f6545fd6-b880-416e-af05-1c700187f823 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.244960 Aug 31 19:20:45.377704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 251/462] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:45 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:45.452104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] validate_networks() for [('65051338-00b4-459c-8f05-d190e2d29e4b', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:20:45.541325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:45.542778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:45.552749 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:45.553526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:45.554145 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:45.554947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:45.555591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:45.556091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:45.849448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:45.857336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f965ff17-dc7e-468d-83fa-0bce086d6ff3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.320301 Aug 31 19:20:45.871556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 252/463] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:45 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:45.876444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:45.877113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:45.884852 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:45.885600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:45.885769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:45.886653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:45.887254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:45.887840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.083039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:20:46.083445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:20:46.084199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:20:46.084688 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:20:46.085297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:20:46.098613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.099446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.100048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.100946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.101636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.102315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.109456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:46.119423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-670795e0-e9ce-4326-82bb-33e7d704ae8e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.246655 Aug 31 19:20:46.120381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 253/464] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:45 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:46.139822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:20:46.146281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:20:46.159848 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:20:46.162711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:20:46.223512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e7eba030-27d6-4114-8517-36c14c49e988 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 21.068899 Aug 31 19:20:46.225120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 212/465] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:20:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 21072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:20:46.238871 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-478a24de-2251-49a5-90d2-c5a65b13a064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:46.239756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-478a24de-2251-49a5-90d2-c5a65b13a064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:46.318467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-478a24de-2251-49a5-90d2-c5a65b13a064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:46.326753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-478a24de-2251-49a5-90d2-c5a65b13a064 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1241 microversion: 2.1 time: 0.094032 Aug 31 19:20:46.327409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 254/466] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:46 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:46.402145 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:46.403303 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:46.412881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.413557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.414286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.415005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.415520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.416061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.600386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:46.608840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:46.611391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:46.612894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f6a82efe-1c72-4fd4-9c23-6f7a730b54e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.214879 Aug 31 19:20:46.613449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 213/467] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:46 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:46.878781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:46.879288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:46.886125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.886592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.887037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:46.887697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:46.888175 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:46.888611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.019775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.027455 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fcc3887d-456d-4f63-9011-dac265bbc8a1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.152657 Aug 31 19:20:47.028016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 255/468] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:46 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:47.144230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:47.144782 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:47.150785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.151270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.151705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.152407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.152903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.153325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.290505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.302348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-415d6faf-0361-4124-af7e-5087cb373d79 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.163243 Aug 31 19:20:47.302932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 214/469] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:47 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:47.348073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:47.348717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:47.355341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.355821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.356258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.356991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.357442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.358420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.421046 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.430202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c7b0a395-db3f-4145-a3fb-8796d7dbda74 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1245 microversion: 2.1 time: 0.086516 Aug 31 19:20:47.430782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 256/470] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:47 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:47.635811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:47.636432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:47.643230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.644239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.644698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.645398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:47.645831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:47.646247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:47.789445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.797935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.799618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:47.800844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-674cf5ca-c731-4df6-939c-90883160de35 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.168941 Aug 31 19:20:47.801421 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 215/471] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:47 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:48.050650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:48.051543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:48.064923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.065767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.067816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.068746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.069634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.070286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.255399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.274494 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4e1d372c-3dac-4922-97e4-aac312098876 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.228142 Aug 31 19:20:48.289500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 257/472] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:48 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:48.326255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:48.326929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:48.346806 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.347962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.352384 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.354709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.355918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.356701 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.453362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:48.454689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:48.465439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.465946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.466573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.467434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.468031 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.468457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.539346 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.547024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2b8000c6-3db5-42c9-b51d-81cc90a7ecad tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1237 microversion: 2.1 time: 0.099385 Aug 31 19:20:48.547821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 258/473] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:48 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:48.572234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.581263 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-95fdc418-af00-4159-9cc5-1e6dedcdcf11 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.259499 Aug 31 19:20:48.582062 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 216/474] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:48 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:48.824831 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:48.825353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:48.832378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.832950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.833362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.834082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:48.834534 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:48.835161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:48.987498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.995802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.997283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:48.998441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-35a791fd-726e-4794-b34a-808493c8dcac tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.177706 Aug 31 19:20:48.999016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 259/475] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:48 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:49.314881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:49.315538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:49.321562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.322369 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.322811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.323513 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.324160 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.324664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.473356 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:49.481299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a322d77d-78dc-41ab-9ea2-c424e726a016 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.170868 Aug 31 19:20:49.481875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 217/476] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:49 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:49.573897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:49.574488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:49.581597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.582080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.582511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.583200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.583651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.584069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.602779 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:49.603300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:49.609213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.609916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.610526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.611418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:49.611903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:49.612325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:49.648715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:49.658948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-09b9ccd8-8485-4991-8910-76c73712c129 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1237 microversion: 2.1 time: 0.089265 Aug 31 19:20:49.664186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 260/477] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:49 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:49.767401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:49.776482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c30e3f81-c035-4957-801a-2d220ac88ddb tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.177557 Aug 31 19:20:49.777086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 218/478] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:49 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:50.026422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:50.027056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:50.033743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.034226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.034661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.035351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.035824 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.036250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.208022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:50.218138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:50.220731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:50.222319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-746aa631-5e64-4ed6-86a8-cbefe976c874 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.199959 Aug 31 19:20:50.233045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 261/479] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:50 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:50.505751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:50.506616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:50.521920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.522349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.522791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.523530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.523989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.524435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.680857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:50.681472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:50.699773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.700522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.701262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.702437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:50.703780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:50.704440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:50.918007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:50.949657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-083b87ae-1b29-493f-b5ec-5ca5613d2da2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1293 microversion: 2.1 time: 0.255662 Aug 31 19:20:50.970001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 262/480] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:50 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:50.987853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:50.992350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:50.996491 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:51.009493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:51.010254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:51.010936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:51.012082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:51.012946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:51.013590 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:51.037902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54ff940b-2b8c-49b1-a4ce-eeaa65deb890 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.536938 Aug 31 19:20:51.059568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 219/481] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:50 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:51.248919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:51.257052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:51.271760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:51.275473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:51.276032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:51.277985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:51.278792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:51.279256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:51.279692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:51.284016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ffc55c49-31e9-4392-a78b-a8f4313b0439 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.319679 Aug 31 19:20:51.284954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 263/482] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:50 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:51.687513 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:51.711916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:51.715209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:51.717197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4af34d4d-9bc9-45df-afd7-8793b55528e0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.473312 Aug 31 19:20:51.718154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 220/483] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:51 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:52.020681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:52.021536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:52.039198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.039852 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.045326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.046460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.047732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.049092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.072232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:52.073305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:52.086637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.090886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.091461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.092310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.101392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.107835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.270154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:52.284640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b29585a2-6b6a-4b80-919e-93380296108e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1293 microversion: 2.1 time: 0.270653 Aug 31 19:20:52.295422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 264/484] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:52 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1293 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:52.313723 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:52.315821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:52.327615 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.328889 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.329870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.332039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.333327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.334665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.473328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:52.482345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3245c71c-36f1-45c5-b621-0d7c2139b005 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.413880 Aug 31 19:20:52.484516 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 221/485] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:52 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:52.544004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:52.548274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:52.567639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bffb6ca3-ffdd-4be9-b54a-c1482ac39c83 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.261095 Aug 31 19:20:52.582728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 265/486] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:52 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:20:52.742568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:52.743298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:52.753381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.754182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.754632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.755337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:52.755787 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:52.756212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:52.993837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:53.019951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:53.025734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:53.028841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5462deda-5e4b-4bf1-bbb3-0416c64a3196 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.288721 Aug 31 19:20:53.030097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 222/487] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:52 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:53.309601 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:53.311447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:53.320179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.321033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.321672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.322660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.323495 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.324249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.411657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:53.419941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-736758ea-341e-4cb8-8d10-a51f6fd7c5cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1301 microversion: 2.1 time: 0.115473 Aug 31 19:20:53.435227 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 266/488] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:53 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1301 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:53.504719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:53.505850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:53.530142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.530693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.531146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.531916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.532400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.532918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.596091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:53.598041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:53.619250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.620030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.621274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.624793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.626925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.627565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.818744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:53.835643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-86b484be-485d-422d-9e64-b79590f2c919 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1501 microversion: 2.1 time: 0.333529 Aug 31 19:20:53.840301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 223/489] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:53 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1501 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:53.871932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e6bc14-a272-454a-8fac-e96a8f18e134"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:53.878499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:53.903345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.915284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.916503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:53.918359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:53.920440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:53.923021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.044164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] HTTP exception thrown: Cannot 'attach_volume' instance d7220888-b7b3-4d53-80fd-85596b3370cb while it is in vm_state rescued Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Request method failure captured: Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/os-volume_attachments HTTP/1.1 Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 74 Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PeVr-VH7V6H-jdY3ceG7PwqENqKNvCM8u4JaVcyvyGnstm48zEmYLv80PCi8p3GbTd5yBYWIeNZfxczjK__7hbOaO72FX4-dm6B09eskqpUkjGsmWBTSX_VPgolDJVn79VVcGnGfMXphvUiyFakP990ImyMlyTAwjRfrjtQKMu3qY Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:20:54.052470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: fd0f7f51482040d7a89df3f7502c2638 Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {"volumeAttachment": {"volumeId": "a8e6bc14-a272-454a-8fac-e96a8f18e134"}} Aug 31 19:20:54.055357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Cannot 'attach_volume' instance d7220888-b7b3-4d53-80fd-85596b3370cb while it is in vm_state rescued Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'server_id': 'd7220888-b7b3-4d53-80fd-85596b3370cb', 'body': {'volumeAttachment': {'volumeId': 'a8e6bc14-a272-454a-8fac-e96a8f18e134'}}} Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7220888-b7b3-4d53-80fd-85596b3370cb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:20:54.056842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d7220888-b7b3-4d53-80fd-85596b3370cb while it is in vm_state rescued Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:20:54.059266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:20:54.061471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:20:54.061471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:20:54.061471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d7220888-b7b3-4d53-80fd-85596b3370cb while it is in vm_state rescued Aug 31 19:20:54.061471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:20:54.061931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:54.074219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Returning 409 to user: Cannot 'attach_volume' instance d7220888-b7b3-4d53-80fd-85596b3370cb while it is in vm_state rescued {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:20:54.074219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fb242593-b198-4570-ba14-fa2cffc9ed55 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.207450 Aug 31 19:20:54.074219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 224/490] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:20:53 2022] POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/os-volume_attachments => generated 152 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 19:20:54.074666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9afb7fa8-3dc1-4cda-bbb0-bc221ca73a9e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.479401 Aug 31 19:20:54.074666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 267/491] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:53 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:54.108054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:20:54.109380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:54.115289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:54.134008 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:54.194041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.198599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.207304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.213416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.214337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.215067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.215791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.216585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.217265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.222138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.224547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.225337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.457694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dbab04db-b010-4a9e-a37c-ebce03bd2a97 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/action" status: 202 len: 0 microversion: 2.1 time: 0.372324 Aug 31 19:20:54.459364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 268/492] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:20:54 2022] POST /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:20:54.478622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:54.481923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:54.503370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.504672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.518273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.519487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:54.520003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:54.520492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:54.961590 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:54.979166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c0a89fcd-a0e4-4b86-b3f5-01838a5e29b9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1311 microversion: 2.1 time: 0.518234 Aug 31 19:20:54.980355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 269/493] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:54 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1311 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:54.992544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:54.993542 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:55.002048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:55.002533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:55.002996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:55.003776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:55.004562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:55.004736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:55.206215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:55.223758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:55.225397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:55.226869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ec9e317-e8ba-45c9-9453-435dc76618bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 1.144085 Aug 31 19:20:55.227617 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 225/494] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:54 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:55.232952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:55.233560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:55.240937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:55.241800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:55.242884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:55.243879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:55.244527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:55.245137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:55.349561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:55.359626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-09dba893-99a7-45ef-8d5c-c173fe51b50b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1509 microversion: 2.1 time: 0.377824 Aug 31 19:20:55.361785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 270/495] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:54 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:55.556491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:55.577732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5f2ea6ec-9704-4b41-a566-bbebabb126c4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.348882 Aug 31 19:20:55.579199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 226/496] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:55 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:56.007519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:56.009573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:56.018935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:56.029100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.030463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.031041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.033465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.034251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.034843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.140436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:56.154589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-962e3d8c-a71d-4a9b-a238-2cb7b33c6407 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1299 microversion: 2.1 time: 0.152041 Aug 31 19:20:56.158076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 271/497] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:56 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:56.257444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:56.258872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:56.271021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:56.274483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:56.291841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.293393 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.294294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.295714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.299126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.300086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.400368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:56.401344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:56.404763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:56.433420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.434256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.440462 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:56.443503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:56.445579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:56.446207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.054385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.063724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7a0addaa-89f8-4b20-ba82-29475656734c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1509 microversion: 2.1 time: 0.668980 Aug 31 19:20:57.077429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 272/498] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:56 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:57.077429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:57.077823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:57.081148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.100804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.102364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.103569 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a7a0f1db-d0c3-4c9e-8d46-1d4fee69044a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.855047 Aug 31 19:20:57.104139 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 227/499] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:56 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:57.112763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.112763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.112763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.112763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.113141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.113141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.190293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:57.191228 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:57.210107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.211924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.214084 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.214982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:57.215594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:57.216170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:57.471684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.486849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a0aef66f-579c-46fe-b8a6-200428145191 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1299 microversion: 2.1 time: 0.302334 Aug 31 19:20:57.487547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 228/500] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:57 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:57.850438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:57.860866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-36440da9-d062-4199-aeb7-8f3109fa470b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.790916 Aug 31 19:20:57.862237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 273/501] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:57 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:58.090739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:58.091711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:58.103583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.104450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.105197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.106561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.108018 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.108754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.130134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:58.132679 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:58.146995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.148752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.151487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.152541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.153128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.157558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.162660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:20:58.469611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:58.482715 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3ddbc731-2fb8-4817-9a1e-1824920c925e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1509 microversion: 2.1 time: 0.397886 Aug 31 19:20:58.484414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 229/502] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:58 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:58.513527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:58.514079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:58.514365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:58.523285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.524304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:58.525782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:58.526945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-32db4fc3-8a01-488b-bfca-699154f50cc8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.403126 Aug 31 19:20:58.527497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 274/503] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:58 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:20:58.528827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.531926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.536407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.538440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.538897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.885937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:58.886554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:58.919205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.919799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.920329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:58.928606 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:58.929113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:58.929754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.116248 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:59.127434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9a7ae373-c7e9-470b-a62f-f8a8fb29b2d8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.619790 Aug 31 19:20:59.128707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 230/504] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:58 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:59.291352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:59.302316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-99fd1284-484a-453f-a086-1f810511b328 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.421802 Aug 31 19:20:59.305891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 275/505] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:58 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:59.510881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:59.511559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:59.523432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:59.524128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:59.524941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.525824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:59.526505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:59.527093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.559400 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:20:59.560164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:20:59.575438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:59.575935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:59.582942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.583674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:20:59.584157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:20:59.584625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:20:59.906833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:59.918747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8430dcb8-d434-4b5d-b527-5e75ef9a7076 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1509 microversion: 2.1 time: 0.412791 Aug 31 19:20:59.919616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 231/506] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:20:59 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:20:59.950773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:59.959620 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:59.961118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:20:59.962324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9d8b7715-22c8-44df-92b6-22278ef481d8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.409068 Aug 31 19:20:59.962972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 276/507] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:20:59 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:00.150885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:00.152297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:00.159641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:00.160373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:00.161022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:00.162690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:00.163457 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:00.164164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:00.329048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:00.330437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:00.338884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:00.339792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:00.340457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:00.341457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:00.342505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:00.343210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:00.373768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:00.385333 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4d8a049a-6c8a-481e-a6b3-161a6a9776bb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.238204 Aug 31 19:21:00.387142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 232/508] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:00 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:00.519437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:00.528209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-47fa5b66-b409-47e8-87fd-960c7de465e0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.204506 Aug 31 19:21:00.529093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 277/509] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:00 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:00.946910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:00.947906 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:00.962169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:00.963285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:00.964327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:00.965917 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:00.966741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:00.967742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:00.995911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:00.996712 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:01.010642 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.011659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.013027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.016049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.020949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.021769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.395267 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:01.426448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2bbf18df-3287-485a-8221-08df5f15122f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1509 microversion: 2.1 time: 0.477659 Aug 31 19:21:01.429443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 233/510] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:00 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:01.433519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:01.444149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:01.446192 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:01.448982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:01.450111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:01.450535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2820d8e2-bcd8-43f6-9a04-91ed66d91509 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.458124 Aug 31 19:21:01.464928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 278/511] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:00 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:01.465142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.465142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.465142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.465142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.465926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.466961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.554117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:01.554737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:01.564933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.565421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.565845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.566572 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:01.569362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:01.570079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:01.776987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:01.797546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cf403153-2d8e-47d5-81ac-2e4c2d025dbd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.365795 Aug 31 19:21:01.802205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:01.809938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 234/512] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:01 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:01.811140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e78a4286-6ab4-448f-b55e-66075d5b2834 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.262699 Aug 31 19:21:01.811690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 279/513] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:01 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:02.451912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:02.454965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:02.462898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.464162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.465125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.466362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.466932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.467605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.476792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:02.478949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:02.494723 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.497913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.499391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.501484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.506533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.508503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.811588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:02.821955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:02.824209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:02.826585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2b43738b-f8dd-4f8e-b016-9e8562a22ef3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.355376 Aug 31 19:21:02.827682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 280/514] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:02 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:02.831046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:02.839538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cfcac714-6a87-4759-a525-9f3486e7ba05 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1509 microversion: 2.1 time: 0.393290 Aug 31 19:21:02.840332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 235/515] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:02 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:02.848039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:02.849029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:02.860469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:02.861554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:02.863783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.864791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.865996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.867557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.868419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.868716 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.869255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.869459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.870049 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.870924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:02.871548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:02.872128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:02.922282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:03.280281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:03.293408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e327a375-6a2a-495f-97cb-c26edb592e60 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.464334 Aug 31 19:21:03.308205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 281/516] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:02 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:03.313896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2049870115", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:03.385288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:03.407241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] validate_networks() for None {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:21:03.421357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ee028a0-5e4a-4b57-82c0-c6b6cd42a689 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.567436 Aug 31 19:21:03.425148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 236/517] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:02 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:03.851622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:03.852351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:03.858665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:03.859190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:03.865596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:03.868309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:03.869221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:03.869959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.324509 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.334879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.336529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.337966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-157ad43b-38a3-420b-a719-33682292d941 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.490701 Aug 31 19:21:04.350590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 237/518] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:03 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:04.355875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:04.356968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:04.363482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:21:04.364155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:21:04.364668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:21:04.365083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:21:04.365499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:21:04.371807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.372296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.377699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.378412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.378882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.379314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.383053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.383545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.383985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.384755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.385213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.385672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.404634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Getting quotas for project d9f01988234948f18e7182e829cbcf0b. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:04.409166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Getting quotas for user c5efa16ebc44403b8382ecc784e1eddf and project d9f01988234948f18e7182e829cbcf0b. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:04.421833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:21:04.427105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:21:04.474745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b77d30e8-2c4c-45db-a169-83547a957465 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165240 Aug 31 19:21:04.475442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 282/519] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:21:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:21:04.481692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-60c000f4-e231-4079-8d07-d152c5946522 req-b5ece49e-1952-432e-b954-7db977e0cbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed0083d-53d6-4dde-adff-552a74a61c5f", "tag": "1cc9f64a-9a42-4ece-874b-739926a8e215"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:04.491281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-60c000f4-e231-4079-8d07-d152c5946522 req-b5ece49e-1952-432e-b954-7db977e0cbf7 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.491998 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-60c000f4-e231-4079-8d07-d152c5946522 req-b5ece49e-1952-432e-b954-7db977e0cbf7 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.492402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-60c000f4-e231-4079-8d07-d152c5946522 req-b5ece49e-1952-432e-b954-7db977e0cbf7 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.509463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-60c000f4-e231-4079-8d07-d152c5946522 req-b5ece49e-1952-432e-b954-7db977e0cbf7 service nova] Creating event network-changed:1cc9f64a-9a42-4ece-874b-739926a8e215 for instance 0ed0083d-53d6-4dde-adff-552a74a61c5f on hv-cinder-85221 Aug 31 19:21:04.516811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-60c000f4-e231-4079-8d07-d152c5946522 req-b5ece49e-1952-432e-b954-7db977e0cbf7 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038916 Aug 31 19:21:04.517617 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 283/520] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:04.523635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:04.524316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:04.533446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.534125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.534994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.535799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.537448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.538150 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.538855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.542473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b050b95a-738a-4b4c-94c5-5f7aa76d6ebf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1515 microversion: 2.1 time: 0.190464 Aug 31 19:21:04.564624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 238/521] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:04 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:04.580223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:04.580864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:04.587805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.588292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.590581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.591314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:04.591774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:04.592195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:04.751163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.759935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a27c35fc-3a02-4f8c-8338-f520efda681c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.240383 Aug 31 19:21:04.760760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 284/522] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:04 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:04.767872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c21b6e1d-ff1f-4c67-bb24-9d8e7671f9dd tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:04.769118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c21b6e1d-ff1f-4c67-bb24-9d8e7671f9dd tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:04.849450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c21b6e1d-ff1f-4c67-bb24-9d8e7671f9dd tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.850785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:04.861311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-55af3147-0416-44d3-9c25-5d3d87817991 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.301454 Aug 31 19:21:04.862794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c21b6e1d-ff1f-4c67-bb24-9d8e7671f9dd tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1215 microversion: 2.1 time: 0.099936 Aug 31 19:21:04.862990 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 239/523] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:04 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:04.863377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 285/524] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:04 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:05.359290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:21:05.359534 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Wed Aug 31 19:21:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 (ip 10.222.0.95) !!! Aug 31 19:21:05.364209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:05.364836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:05.371759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.372237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.372698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.373378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.373829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.374250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.505816 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:05.513799 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:05.515270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:05.516504 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fbbc6f27-e487-4fdd-81f2-167a277b800b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.158429 Aug 31 19:21:05.517072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 240/525] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:05 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:05.783069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:05.783675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:05.794323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.794822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.795258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.795957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.796405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.797597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.883230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:05.883840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:05.889978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.890502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.891192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.891629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.892085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.892513 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.943051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:05.957323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-75b2076a-8b11-4cf9-b08c-a0d2b576c46f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.178272 Aug 31 19:21:05.957908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 286/526] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:05 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:05.958162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:05.962354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:05.962974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:05.965923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fc1d84e1-43ed-4b25-9831-a63e5cc001a9 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1219 microversion: 2.1 time: 0.086441 Aug 31 19:21:05.966475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 241/527] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:05 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:05.971679 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.972081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.972739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:05.973552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:05.974134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:05.974678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:06.108896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:06.117753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e3640b8e-8a47-41ea-804a-6eb61965d00a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.158890 Aug 31 19:21:06.118318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 287/528] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:05 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:06.539574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:06.540199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:06.546204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:06.547206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:06.547689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:06.548828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:06.548828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:06.549167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:06.679948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:06.687888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:06.689433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:06.690566 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0aab8597-fd60-4e2b-aeb4-3bb30a96a283 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.155160 Aug 31 19:21:06.691111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 242/529] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:06 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:06.978387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:06.978993 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:06.985826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:06.986310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:06.986745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:06.987096 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:06.987523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:06.987699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:06.987876 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:06.988299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:06.993641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:06.994116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:06.994543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:06.995222 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:06.995663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:06.996083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.078491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.086293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-19d209b1-88ca-4a88-bfe6-ac9ec0eedd8f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1219 microversion: 2.1 time: 0.102961 Aug 31 19:21:07.086845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 243/530] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:06 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:07.140876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:07.141812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:07.147433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.148475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.149068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.149854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.150767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.151438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.151933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.156714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6f28edac-465b-4e17-a6cc-d5492f7c6ede tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.181596 Aug 31 19:21:07.157666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 288/531] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:06 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:07.313619 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.322333 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-736e3a69-2c8f-43eb-9e3e-843efd994311 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1723 microversion: 2.1 time: 0.186809 Aug 31 19:21:07.331001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 244/532] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:07 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:07.714464 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:07.715065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:07.721779 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.722252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.722708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.723391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:07.723843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:07.724260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:07.868552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.880693 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.882591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:07.884235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ac7a6e5a-c77c-425f-a804-5d96ba6af095 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1736 microversion: 2.20 time: 0.173781 Aug 31 19:21:07.885288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 289/533] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:07 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:08.108401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:08.110447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:08.116361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.117201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.118152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.119727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.120592 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.121171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.174471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-989f558e-d95f-4b5e-8fca-b397d093a711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'create', calling method: .version_select at 0x7f975fb0b550>, body: {"keypair": {"name": "tempest-keypair-227283502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAgJNCPZvQt8AISsxlOMm6yx7BCprV3oy0lHWRogK99SxvkfJ2r5uQPR+Cnhs2O5bIK2/UxFOp6qSVbM5ExQvIh3QN+fEckOtiWsFRXxAMG5EdZznvjYDQfIU7iuFXq0Q=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:08.196463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-989f558e-d95f-4b5e-8fca-b397d093a711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for project a1342c2dbb1c41dca6061505220d9de7. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:08.202777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-989f558e-d95f-4b5e-8fca-b397d093a711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for user fd0f7f51482040d7a89df3f7502c2638 and project a1342c2dbb1c41dca6061505220d9de7. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:08.233563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:08.240287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-989f558e-d95f-4b5e-8fca-b397d093a711 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071188 Aug 31 19:21:08.242575 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-41516af2-8b8a-43d3-a731-763d9e5da1fb tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1267 microversion: 2.1 time: 0.137956 Aug 31 19:21:08.243456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 245/534] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:08 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:08.247809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 290/535] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:21:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:08.248432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:08.249086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:08.256067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.256548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.257016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.257778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.258229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.258649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.262960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:08.345350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:08.346078 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:08.352697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.353191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.353682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.354388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.355008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.355739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.632674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:08.641639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-01d15284-ac75-4a4e-8040-b4d5acc06c99 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.397049 Aug 31 19:21:08.642220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 246/536] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:08 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:08.692117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:08.701058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-85e541ec-49cd-42a5-8973-c5908c90194e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1700 microversion: 2.1 time: 0.361236 Aug 31 19:21:08.708010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 291/537] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:08 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1700 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:08.726223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-accae157-b7c1-413d-98f1-728629641fa2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:08.739069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-accae157-b7c1-413d-98f1-728629641fa2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.739708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-accae157-b7c1-413d-98f1-728629641fa2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.740274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-accae157-b7c1-413d-98f1-728629641fa2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.807678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-accae157-b7c1-413d-98f1-728629641fa2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Going to try to start instance {{(pid=120707) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 19:21:08.866831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-accae157-b7c1-413d-98f1-728629641fa2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action" status: 202 len: 0 microversion: 2.1 time: 0.144063 Aug 31 19:21:08.868282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 247/538] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:21:08 2022] POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:21:08.879707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:08.880524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:08.888878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.889547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.889943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.891212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.891688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.892115 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.916600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:08.919105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:08.930066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.944391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.945076 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:08.945941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:08.947114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:08.947684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.378011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.386932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-aa56e96c-ad4a-4703-952b-8e97933ca0ac tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1709 microversion: 2.1 time: 0.511971 Aug 31 19:21:09.387518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 292/539] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:08 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1709 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:09.390072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.394979 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:09.395775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:09.401742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.401918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.402376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.402731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.403483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.403897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.404405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.404871 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.405592 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8631aa22-e6b3-4d70-8e80-1b7fce9a5453 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1718 microversion: 2.20 time: 0.496159 Aug 31 19:21:09.407782 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 248/540] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:08 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1718 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:09.474393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.482509 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-77138bc1-22c7-43e0-814b-ff10a2639473 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1273 microversion: 2.1 time: 0.093580 Aug 31 19:21:09.483084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 293/541] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:09 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:09.662967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:09.663570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:09.670218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.670686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.671292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.673802 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:09.673802 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:09.674486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:09.975762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:09.988451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8b97c249-f3cd-429e-a2d6-e79c238db488 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.329604 Aug 31 19:21:09.989867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 249/542] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:09 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:10.420988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:10.422458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:10.435903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:10.436596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:10.438992 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.440190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.441663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.442906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.444318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.445158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.449302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.449704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.450152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.451153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.451326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.451749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.717520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:10.731548 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2f04662e-213e-44ff-ace8-3bfb5ff33d4c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1709 microversion: 2.1 time: 0.317155 Aug 31 19:21:10.733335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 294/543] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:10 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1709 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:10.741353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:10.742202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:10.752374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.753134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.753763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.755184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:10.755798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:10.757217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:10.772240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:10.783155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:10.785093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:10.788808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b668faaf-662e-4bb7-8cfe-2960f8fd7ddb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1718 microversion: 2.20 time: 0.359853 Aug 31 19:21:10.789331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 250/544] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:10 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1718 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:10.867105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:10.881734 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ae0640ec-574a-4bdb-912f-21bd37df0da6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1273 microversion: 2.1 time: 0.145155 Aug 31 19:21:10.883089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 295/545] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:10 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:11.011388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:11.012246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:11.019404 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.020123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.020826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.021687 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.022281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.022904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.230784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-3c88d1ac-cc5c-4880-a56a-8765c3551f87 req-2d623307-7f7c-48ee-ad63-73783b3dec90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "name": "network-vif-unplugged", "status": "completed", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:11.247866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3c88d1ac-cc5c-4880-a56a-8765c3551f87 req-2d623307-7f7c-48ee-ad63-73783b3dec90 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.248727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3c88d1ac-cc5c-4880-a56a-8765c3551f87 req-2d623307-7f7c-48ee-ad63-73783b3dec90 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.249322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3c88d1ac-cc5c-4880-a56a-8765c3551f87 req-2d623307-7f7c-48ee-ad63-73783b3dec90 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.265470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-3c88d1ac-cc5c-4880-a56a-8765c3551f87 req-2d623307-7f7c-48ee-ad63-73783b3dec90 service nova] Creating event network-vif-unplugged:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:21:11.271662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:11.276331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-3c88d1ac-cc5c-4880-a56a-8765c3551f87 req-2d623307-7f7c-48ee-ad63-73783b3dec90 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049442 Aug 31 19:21:11.277505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 296/546] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:11.283727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0bedcbd0-e222-4b46-a32f-20a0e6438db0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.275983 Aug 31 19:21:11.284314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 251/547] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:11 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:11.697541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-424842978", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "201376f0-1504-4d78-ac2c-2c94758d5b0e"}], "security_groups": [{"name": "tempest-securitygroup--1391688538"}], "key_name": "tempest-keypair-227283502", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:11.753418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:11.754028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:11.771526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.772010 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.772436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.773164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:11.773608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:11.774022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:11.870939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] validate_networks() for [('201376f0-1504-4d78-ac2c-2c94758d5b0e', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:21:12.002358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:12.013258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2eea02e4-5081-4ae6-8918-b5f6e3b783bd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1709 microversion: 2.1 time: 0.263717 Aug 31 19:21:12.013832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 252/548] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:11 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:12.019526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:12.020360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:12.028187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.028905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.029560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.030465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.031980 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.032561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.320613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:12.329434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:12.331232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:12.332860 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-777e3224-bb81-4acd-ab54-3ba79ad61938 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1718 microversion: 2.20 time: 0.317291 Aug 31 19:21:12.333952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 253/549] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:12 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1718 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:12.338830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:12.339954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:12.346003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:12.348508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.349418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.350067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.351033 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.351497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.351921 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.829477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:21:12.829951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:21:12.830516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:21:12.830989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:21:12.831356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:21:12.841634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.842331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.842913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.843966 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.845868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.846382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.867725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for project a1342c2dbb1c41dca6061505220d9de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:12.873930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Getting quotas for user fd0f7f51482040d7a89df3f7502c2638 and project a1342c2dbb1c41dca6061505220d9de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:12.886803 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:12.896554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:21:12.898595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-21577228-927f-4a4b-96e9-22f142142109 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.563232 Aug 31 19:21:12.908630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:21:12.909946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 254/550] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:12 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:12.924239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:12.925345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:12.933745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.934642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.935524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.936768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:12.938315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:12.939067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:12.975840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-141060d9-69df-4f35-a4b4-8cc1031111c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.283458 Aug 31 19:21:12.982770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 297/551] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:21:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:21:12.988990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ee944b9-b843-4f1e-8b9a-0ac9a80f8e72 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:12.989751 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ee944b9-b843-4f1e-8b9a-0ac9a80f8e72 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:13.355657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ee944b9-b843-4f1e-8b9a-0ac9a80f8e72 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:13.374939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ee944b9-b843-4f1e-8b9a-0ac9a80f8e72 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1244 microversion: 2.1 time: 0.390704 Aug 31 19:21:13.375693 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 298/552] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:12 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1244 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:13.394922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:13.395410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:13.404771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:13.408013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:13.409191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:13.410426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:13.411369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:13.412309 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:13.412950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:13.496360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:13.506349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-614db161-c0e9-4d97-8791-f058ac602fa8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.589431 Aug 31 19:21:13.506902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 255/553] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:12 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:13.534578 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:13.554347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:13.573065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:13.574311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:13.575195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:13.607479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:13.608288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:13.612791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:13.856187 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:13.874200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-794ddcd4-8fff-44d2-860e-5ac0c7b54409 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1709 microversion: 2.1 time: 0.484987 Aug 31 19:21:13.875809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 299/554] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:13 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1709 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:13.923838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:13.925476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:13.935347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:13.936194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:13.938109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:13.939244 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:13.940206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:13.941441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.057356 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.074020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.084598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.092747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d6318f0d-e29f-4c67-85fe-2ac326215e46 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1718 microversion: 2.20 time: 0.578224 Aug 31 19:21:14.096231 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 256/555] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:13 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1718 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:14.206927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.218470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6d7f42e0-23ea-4aac-bc1e-35490ae235fe tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.299283 Aug 31 19:21:14.221445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 300/556] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:13 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:14.403709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:14.424561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:14.441863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.442604 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.443137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.443924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.444377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.445047 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.530595 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:14.533710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:14.554203 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.555001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.555600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.559147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.559988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.561056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.586620 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.600939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3e453950-2ee6-41ec-aa43-5d330d49e3ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1296 microversion: 2.1 time: 0.206824 Aug 31 19:21:14.601974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 257/557] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:14 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1296 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:14.727842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:14.736546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c7c6b8e4-a893-4136-8a84-3b7a687696e3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.213524 Aug 31 19:21:14.737221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 301/558] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:14 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:14.897128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:14.898278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:14.916070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.916600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.917038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:14.917749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:14.918206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:14.918642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.122478 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:15.124085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:15.150195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.150965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.151418 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.155912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.158369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.162338 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.393877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.457032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a5a830b9-52c7-4585-870c-e1cfeaef356d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1709 microversion: 2.1 time: 0.563490 Aug 31 19:21:15.470426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 258/559] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:14 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1709 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:15.476956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.477959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:15.478787 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:15.488444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.489692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.491345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.491828 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.493158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.494602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.495931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.496947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.497705 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-58daa2b6-5c75-4c52-b905-a9c2e217336f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1721 microversion: 2.20 time: 0.382103 Aug 31 19:21:15.500430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 302/560] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:15 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1721 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:15.518105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a66b61ad-fe9a-4c83-a4fd-ed436ed88ae5 req-9f2dd073-b178-49a0-9cac-f4b0772484bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89bbe0cb-0063-4409-968c-0d6001b17802", "tag": "c77c0bc0-95cf-469d-9e2d-6e371298afe9"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:15.540821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a66b61ad-fe9a-4c83-a4fd-ed436ed88ae5 req-9f2dd073-b178-49a0-9cac-f4b0772484bd service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.541699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a66b61ad-fe9a-4c83-a4fd-ed436ed88ae5 req-9f2dd073-b178-49a0-9cac-f4b0772484bd service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.542123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a66b61ad-fe9a-4c83-a4fd-ed436ed88ae5 req-9f2dd073-b178-49a0-9cac-f4b0772484bd service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.554718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a66b61ad-fe9a-4c83-a4fd-ed436ed88ae5 req-9f2dd073-b178-49a0-9cac-f4b0772484bd service nova] Creating event network-changed:c77c0bc0-95cf-469d-9e2d-6e371298afe9 for instance 89bbe0cb-0063-4409-968c-0d6001b17802 on hv-cinder-85221 Aug 31 19:21:15.574916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a66b61ad-fe9a-4c83-a4fd-ed436ed88ae5 req-9f2dd073-b178-49a0-9cac-f4b0772484bd service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068748 Aug 31 19:21:15.574916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 303/561] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:15.587948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd07b82d-8b32-49c0-9899-d62ece49e0e5"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:15.591281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:15.598610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.599497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.600170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.601234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.601952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.602590 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.631024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:15.845529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:15.857072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2c902508-4f80-4aff-8f64-b97ac3319865 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.385409 Aug 31 19:21:15.857683 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 259/562] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:15 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:15.876474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:15.877551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:15.885810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.887037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.887827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:15.889599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:15.891605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:15.892308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.000776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:16.012236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a3e81557-5b76-4ec4-9eea-f836badf9712 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1296 microversion: 2.1 time: 0.153291 Aug 31 19:21:16.013155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 260/563] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:15 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1296 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:16.015446 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f1063ecc-3c72-4b79-a275-78fec2fa97b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.442691 Aug 31 19:21:16.016108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 304/564] 10.222.0.95 () {62 vars in 1364 bytes} [Wed Aug 31 19:21:15 2022] POST /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments => generated 188 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:21:16.020620 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-293608072", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "networks": [{"uuid": "ee9b76b7-ab75-440b-80c6-10d48a1b8c28"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:16.021596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-7da1207e-ab19-4ade-90ba-49c10025c7fd req-e2fce09a-2ea8-4008-a90e-2da9ff9e4b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed0083d-53d6-4dde-adff-552a74a61c5f", "name": "network-vif-plugged", "status": "completed", "tag": "1cc9f64a-9a42-4ece-874b-739926a8e215"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:16.034826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7da1207e-ab19-4ade-90ba-49c10025c7fd req-e2fce09a-2ea8-4008-a90e-2da9ff9e4b98 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.035315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7da1207e-ab19-4ade-90ba-49c10025c7fd req-e2fce09a-2ea8-4008-a90e-2da9ff9e4b98 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.035894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7da1207e-ab19-4ade-90ba-49c10025c7fd req-e2fce09a-2ea8-4008-a90e-2da9ff9e4b98 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.052049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-7da1207e-ab19-4ade-90ba-49c10025c7fd req-e2fce09a-2ea8-4008-a90e-2da9ff9e4b98 service nova] Creating event network-vif-plugged:1cc9f64a-9a42-4ece-874b-739926a8e215 for instance 0ed0083d-53d6-4dde-adff-552a74a61c5f on hv-cinder-85221 Aug 31 19:21:16.059461 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-7da1207e-ab19-4ade-90ba-49c10025c7fd req-e2fce09a-2ea8-4008-a90e-2da9ff9e4b98 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041474 Aug 31 19:21:16.061149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 305/565] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:16.069358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:16.070148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:16.080131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.080767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.081649 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.082621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.083096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.083529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.175956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] validate_networks() for [('ee9b76b7-ab75-440b-80c6-10d48a1b8c28', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:21:16.506847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:16.516649 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8e16b23b-9fb5-4356-805b-f0b77ae1f251 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.453115 Aug 31 19:21:16.517417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 306/566] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:16 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:16.522050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:16.523076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:16.528891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.530157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.531654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.532743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.533512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.534409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.594642 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120706) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:21:16.674517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d05159f0-b479-4afb-a65f-b19f751d62f6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/action" status: 202 len: 0 microversion: 2.20 time: 0.155880 Aug 31 19:21:16.675175 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 307/567] 10.222.0.95 () {62 vars in 1319 bytes} [Wed Aug 31 19:21:16 2022] POST /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:21:16.681851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:16.682722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:16.689836 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.690347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.690815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:16.691518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:16.691972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:16.692432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.058316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:17.079278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-68d08722-055b-498e-852f-2f6df68d798b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1713 microversion: 2.1 time: 0.401446 Aug 31 19:21:17.079932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 308/568] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:16 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1713 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:17.099470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:17.100087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:17.107797 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.109090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.109558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.110509 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.110985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.111404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.231983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:21:17.235210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:21:17.236128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:21:17.237149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:21:17.237751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:21:17.252372 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.253288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.253892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.254983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.256381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.257799 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.344137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Getting quotas for project 3b530b6cef6943ee93e561b05d1f846d. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:17.353557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Getting quotas for user 1e04230bb5b34b27aad5c2a46230a5cc and project 3b530b6cef6943ee93e561b05d1f846d. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:17.369834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:21:17.372469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:21:17.482544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2dfacb44-dccc-4948-980f-e72f1ecb2708 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.468168 Aug 31 19:21:17.492978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 261/569] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:21:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:21:17.498307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:17.499143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:17.525023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.525522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.525960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.526673 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.527122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.527794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.579216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:17.732204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:17.754960 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:17.756647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:17.757913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dabe059a-4473-48af-b418-f6616968d45e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1747 microversion: 2.20 time: 0.664240 Aug 31 19:21:17.768633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 309/570] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:17 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1747 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:17.782090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:17.784663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:17.804982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.805481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.805933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.806622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:17.807073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:17.807493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:17.922802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:17.935643 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-614247a0-da3a-4bd6-b9e3-0586c7c8dbb7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1302 microversion: 2.1 time: 0.171333 Aug 31 19:21:17.953737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 310/571] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:17 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1302 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:17.964212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d99740cc-461f-4c2e-9701-20594ab4694a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:17.965450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d99740cc-461f-4c2e-9701-20594ab4694a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:18.441869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d99740cc-461f-4c2e-9701-20594ab4694a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:18.454265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d99740cc-461f-4c2e-9701-20594ab4694a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1218 microversion: 2.1 time: 0.496964 Aug 31 19:21:18.455327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 311/572] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:17 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:18.473631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:18.474523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:18.481010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:18.481862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:18.482516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:18.483477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:18.484275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:18.484983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:18.597447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:18.610134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-226af391-e7cb-4994-9744-73a44736709c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 1.115291 Aug 31 19:21:18.611483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 262/573] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:17 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:18.753554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:18.767733 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-161cdf23-700a-4c15-8575-f8d42f93d9a5 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.310346 Aug 31 19:21:18.771154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 312/574] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:18 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:18.787468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:18.788072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:18.795732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:18.796440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:18.796977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:18.797958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:18.798949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:18.799633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:18.962145 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:18.962755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:18.973758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:18.974581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:18.975697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:18.977217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:18.978169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:18.978927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.050150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.061060 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.063702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.065170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a98b862d-4eea-4d45-9bc7-39283f308021 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1747 microversion: 2.20 time: 0.282814 Aug 31 19:21:19.081325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 263/575] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:18 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1747 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:19.159758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.169742 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-de78b290-cf50-4fad-8b67-6a295bf09604 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.211072 Aug 31 19:21:19.170860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 313/576] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:18 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:19.478406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:19.482019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:19.489405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.489947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.490514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.491283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.491930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.492328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.580721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.591861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cf3492cf-c1cc-461c-bfc0-4a97ff7d3491 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1222 microversion: 2.1 time: 0.119732 Aug 31 19:21:19.592923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 264/577] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:19 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:19.631860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:19.632517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:19.638847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.639346 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.639787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.641160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.641792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.642386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.793035 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:19.793643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:19.794340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:19.801240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.802139 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.802259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b4a7578c-0dbc-4136-9153-1e28f4e5dee3 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.174297 Aug 31 19:21:19.803104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 314/578] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:19 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:19.813696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:19.817929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:19.818502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:19.819020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.014693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.027005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f066cef0-f9f6-43f8-b41c-3a67f5d0fdfe tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1367 microversion: 2.1 time: 0.237937 Aug 31 19:21:20.027745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 265/579] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:19 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:20.088703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:20.089620 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:20.096800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.097580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.098234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.099133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.099774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.100389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.192919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:20.193530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:20.210403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.210892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.211331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.212035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.212480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.213037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.350757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.367425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.370199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.372135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6497c1e3-cf34-4a54-a229-3f54bbe3d1d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1747 microversion: 2.20 time: 0.287523 Aug 31 19:21:20.372934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 315/580] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:20 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1747 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:20.397608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.410070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-785a6f78-f2fa-4c98-ae2c-8e7353e552b0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.221447 Aug 31 19:21:20.417026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 266/581] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:20 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:20.616146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:20.617009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:20.631137 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.633490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.635631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.636684 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.637377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.639377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.754000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:20.762368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9f9953c5-5a96-47af-81ae-c0faf2cc614f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1222 microversion: 2.1 time: 0.152383 Aug 31 19:21:20.762948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 316/582] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:20 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:20.826358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:20.827066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:20.834152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.834638 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.835371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:20.836269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:20.837339 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:20.837942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.042680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.048425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:21.049582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:21.050739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7f200b2e-a843-4f96-940a-5f7f58e56fde tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.228888 Aug 31 19:21:21.051309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 267/583] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:20 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:21.060085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.060678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.063858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.064728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.065261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.065760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.260157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.273881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e1fffb66-5fa2-472f-8893-adb52958391e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1556 microversion: 2.1 time: 0.229120 Aug 31 19:21:21.274675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 317/584] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:21 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1556 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:21.295637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:21.296187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:21.303180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.303671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.304118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.304856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.305480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.306067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.400593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:21.401363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:21.418140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.420799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.426263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.432710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.433040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.438343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ede58347-7eb2-4d53-a409-f55f04aa17ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146734 Aug 31 19:21:21.439543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 268/585] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:21:21 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:21.451277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:21.451508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.454185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:21.470523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.472284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.473577 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.474949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.479038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.479925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.876077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.890973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.892823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:21.894787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3f192b4d-1c09-40c9-b49d-eb7a985b80d7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1747 microversion: 2.20 time: 0.499507 Aug 31 19:21:21.897669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 318/586] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:21 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1747 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:21.905067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:21.906930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:21.917659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.918360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.919008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.931213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:21.934486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:21.935920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:21.942598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.010763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:22.020318 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d6cf5d0a-810b-43a1-bf30-f6059a11903b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.579559 Aug 31 19:21:22.033116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 269/587] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:21 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:22.073468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:22.074079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:22.083379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.084025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.084299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.085235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.085838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.086575 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.094690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:22.106386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-95b8a491-05f6-46db-9c2a-ee45702f5f73 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1270 microversion: 2.1 time: 0.206517 Aug 31 19:21:22.108266 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 319/588] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:21 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:22.461742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:22.475217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-266ccb00-5d5b-48a9-ab45-5e075e48c537 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.406801 Aug 31 19:21:22.490716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 270/589] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:22 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:22.853035 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-c6d3fc5a-0054-415c-88f3-469abb192154 req-afc9c736-abdb-4544-bd82-03fc2e6dc744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d389fb4-28b6-4d7e-80bc-fb896c5bf004", "tag": "1a01f436-a378-4dc6-a024-41f23bb205d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:22.859821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=4 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:22.870645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c6d3fc5a-0054-415c-88f3-469abb192154 req-afc9c736-abdb-4544-bd82-03fc2e6dc744 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.871297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c6d3fc5a-0054-415c-88f3-469abb192154 req-afc9c736-abdb-4544-bd82-03fc2e6dc744 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.871969 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c6d3fc5a-0054-415c-88f3-469abb192154 req-afc9c736-abdb-4544-bd82-03fc2e6dc744 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.886674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-c6d3fc5a-0054-415c-88f3-469abb192154 req-afc9c736-abdb-4544-bd82-03fc2e6dc744 service nova] Creating event network-changed:1a01f436-a378-4dc6-a024-41f23bb205d1 for instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 on hv-cinder-85221 Aug 31 19:21:22.893325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-c6d3fc5a-0054-415c-88f3-469abb192154 req-afc9c736-abdb-4544-bd82-03fc2e6dc744 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043957 Aug 31 19:21:22.894344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 320/590] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:22.925601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:22.926823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:22.933938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.935098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.935265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:22.935981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:22.936536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:22.937108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.057748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:23.058572 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:23.071711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.072315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.075108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.076225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.081289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.081877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.319915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:23.354878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:23.356537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:23.361296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-19fccb11-a9d3-415a-b0f0-adde21ef34d4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1749 microversion: 2.20 time: 0.440065 Aug 31 19:21:23.362648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 271/591] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:22 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1749 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:23.368865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:23.369739 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:23.390718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.391248 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.391709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.392422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.393064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.393878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.601601 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:23.612982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f476ecde-2450-4c09-8c70-0acf059ce6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.559236 Aug 31 19:21:23.613368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 321/592] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:23 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:23.621258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:23.625695 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:23.630132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:23.648087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.653422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.654119 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.666373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-05c3b388-9539-4699-b232-818ca8947b76 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1278 microversion: 2.1 time: 0.301670 Aug 31 19:21:23.669823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.670974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 272/593] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:23 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:23.679135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.683109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.700373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-31bd6428-9878-4fa1-ae12-b7c820fbc9ca req-18fef56a-0e45-4db5-a69e-7dee7752252f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed0083d-53d6-4dde-adff-552a74a61c5f", "tag": "1cc9f64a-9a42-4ece-874b-739926a8e215"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:23.758316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-31bd6428-9878-4fa1-ae12-b7c820fbc9ca req-18fef56a-0e45-4db5-a69e-7dee7752252f service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:23.760136 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-31bd6428-9878-4fa1-ae12-b7c820fbc9ca req-18fef56a-0e45-4db5-a69e-7dee7752252f service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:23.763533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-31bd6428-9878-4fa1-ae12-b7c820fbc9ca req-18fef56a-0e45-4db5-a69e-7dee7752252f service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:23.797515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-31bd6428-9878-4fa1-ae12-b7c820fbc9ca req-18fef56a-0e45-4db5-a69e-7dee7752252f service nova] Creating event network-changed:1cc9f64a-9a42-4ece-874b-739926a8e215 for instance 0ed0083d-53d6-4dde-adff-552a74a61c5f on hv-cinder-85221 Aug 31 19:21:23.814442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-31bd6428-9878-4fa1-ae12-b7c820fbc9ca req-18fef56a-0e45-4db5-a69e-7dee7752252f service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141833 Aug 31 19:21:23.815315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 273/594] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:24.052339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:24.066416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1052ce2d-15a1-419f-ba91-57d7e39f275b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.451944 Aug 31 19:21:24.076688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 322/595] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:23 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:24.385493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:24.386911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:24.396658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.405378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.408316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:24.413981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.414605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.415744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:24.635438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:24.636466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:24.648708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.654871 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.656469 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:24.657907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.658576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.661113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:24.756264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:24.776533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:24.783120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:24.785191 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1b97e5ec-30a7-4051-aeab-1da11c9b89dd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.403972 Aug 31 19:21:24.791892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 274/596] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:24 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:24.798216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:24.800385 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:24.813706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.815170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.815867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:24.817069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:24.817776 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:24.818754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:25.083099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:25.113444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b80fd135-71e4-4df3-8179-2375dd841692 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.482430 Aug 31 19:21:25.114392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 323/597] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:24 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:25.129557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:25.131179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:25.139450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:25.140991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:25.143032 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:25.143991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:25.145165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:25.147522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:25.163330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:25.183249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-92fe1dc6-eb03-45f9-9297-c3964bdd5455 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.389409 Aug 31 19:21:25.183837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 275/598] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:24 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:25.285352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-69c36fbd-8e87-454c-85b1-e396cfbec7a0 req-0dd29d3e-dd66-4810-b186-49a8b9edaad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bbe0cb-0063-4409-968c-0d6001b17802", "name": "network-vif-plugged", "status": "completed", "tag": "c77c0bc0-95cf-469d-9e2d-6e371298afe9"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:25.302989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-69c36fbd-8e87-454c-85b1-e396cfbec7a0 req-0dd29d3e-dd66-4810-b186-49a8b9edaad1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:25.303549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-69c36fbd-8e87-454c-85b1-e396cfbec7a0 req-0dd29d3e-dd66-4810-b186-49a8b9edaad1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:25.303976 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-69c36fbd-8e87-454c-85b1-e396cfbec7a0 req-0dd29d3e-dd66-4810-b186-49a8b9edaad1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:25.332913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-69c36fbd-8e87-454c-85b1-e396cfbec7a0 req-0dd29d3e-dd66-4810-b186-49a8b9edaad1 service nova] Creating event network-vif-plugged:c77c0bc0-95cf-469d-9e2d-6e371298afe9 for instance 89bbe0cb-0063-4409-968c-0d6001b17802 on hv-cinder-85221 Aug 31 19:21:25.341167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-69c36fbd-8e87-454c-85b1-e396cfbec7a0 req-0dd29d3e-dd66-4810-b186-49a8b9edaad1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060129 Aug 31 19:21:25.342472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 276/599] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:25.820084 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:25.820878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:25.829947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:25.830842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:25.832382 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:25.833577 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:25.834324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:25.834916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:26.503226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:26.522401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:26.525480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5660836a-ea0e-46d4-a738-dfda2df85aba tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 1.409535 Aug 31 19:21:26.526303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 324/600] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:25 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:26.534542 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:26.535365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:26.537982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:26.548197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:26.549815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-654514a6-fc9f-4141-a3e5-b5ac3245bc52 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.734239 Aug 31 19:21:26.550569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:26.551322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:26.552151 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:26.553052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:26.553659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:26.554267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:26.567808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 277/601] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:25 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:26.584013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:26.588932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:26.629685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:26.630679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:26.632160 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:26.633651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:26.641578 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:26.642859 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:27.015909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:27.023068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:27.025113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-274ba57c-46f6-4569-acc7-8c6314d1c834 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.495783 Aug 31 19:21:27.025904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 325/602] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:26 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:27.048022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-371fd494-7584-42aa-aee1-b3ea5facf78f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.478370 Aug 31 19:21:27.049736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 278/603] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:26 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:27.466124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a5ef97ac-d7dc-45ef-a929-d0fb7e13ee4f req-de8137be-bc3f-40de-9cbe-12c00887bc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c7d734-295c-4bc0-8233-004d4d31bb36", "tag": "bc5bf427-9fc5-46fe-89e3-39dbe7188e00"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:27.517778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a5ef97ac-d7dc-45ef-a929-d0fb7e13ee4f req-de8137be-bc3f-40de-9cbe-12c00887bc17 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:27.518669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a5ef97ac-d7dc-45ef-a929-d0fb7e13ee4f req-de8137be-bc3f-40de-9cbe-12c00887bc17 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:27.519315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a5ef97ac-d7dc-45ef-a929-d0fb7e13ee4f req-de8137be-bc3f-40de-9cbe-12c00887bc17 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:27.534362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a5ef97ac-d7dc-45ef-a929-d0fb7e13ee4f req-de8137be-bc3f-40de-9cbe-12c00887bc17 service nova] Creating event network-changed:bc5bf427-9fc5-46fe-89e3-39dbe7188e00 for instance 17c7d734-295c-4bc0-8233-004d4d31bb36 on hv-cinder-85221 Aug 31 19:21:27.541636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a5ef97ac-d7dc-45ef-a929-d0fb7e13ee4f req-de8137be-bc3f-40de-9cbe-12c00887bc17 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081329 Aug 31 19:21:27.545351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 326/604] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:27.549999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:27.550622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:27.552750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:27.558180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:27.568426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:27.576766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:27.577485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:27.579955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:27.580414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:27.581187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:27.581642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:27.582075 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:27.587030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:27.587610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:27.588109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:27.589100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:27.589794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:27.590673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:27.859362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:27.863667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:27.870054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:27.872389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:27.873417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-358a8021-3c2f-4c52-b20e-27536a271593 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.327674 Aug 31 19:21:27.874018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ab526ddc-4dfe-441c-a6fe-802d62f1b758 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.303747 Aug 31 19:21:27.878498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 279/605] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:27 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:27.894782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 327/606] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:27 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:28.046838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:28.047738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:28.065235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.066118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.066817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.067777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.069162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.069845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.075680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:28.076298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:28.091005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.091788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.092387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.097503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.098186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.098789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.389417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:28.394551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:28.403539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-19d3dd9e-c9fa-4f42-a518-24ce9a2ae7e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.359830 Aug 31 19:21:28.404455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 280/607] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:28 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:28.446682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=22 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:28.465860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:28.478102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f4d0695d-1d78-4de0-b89f-7953ea8a6881 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.407594 Aug 31 19:21:28.488206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 328/608] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:28 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:28.899710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:28.900319 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:28.908913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.910282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.910882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.912478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.912629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:28.913754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:28.913971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.914443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.922339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.935482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.936376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:28.937545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:28.938152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:28.938733 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:29.198153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:29.208946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:29.210673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:29.212287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd2e6959-9c7b-44ff-aff5-5271f1326151 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.304014 Aug 31 19:21:29.225730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 329/609] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:28 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:29.333395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:29.344466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-db08ecf2-75d8-45e1-ba3e-3cd73103ca17 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.450408 Aug 31 19:21:29.344466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 281/610] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:28 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:29.429284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:29.430222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:29.441283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:29.442117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:29.442793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:29.443769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:29.444448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:29.445135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:29.503161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:29.504082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:29.511643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:29.512289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:29.513036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:29.514019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:29.515173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:29.515995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:29.760635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:29.764105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:29.775059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a624a38b-a9a6-42dc-9da2-c47769947983 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.352333 Aug 31 19:21:29.776878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3f208eec-ea57-4d52-9718-ddc739dd6120 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.277432 Aug 31 19:21:29.778220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 282/611] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:29 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:29.790062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 330/612] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:29 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:30.239365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:30.240221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:30.254790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.255402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.259009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.260196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.260906 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.261959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.369585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:30.370924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:30.379186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.379755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.381781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.384685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.385858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.386359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.673054 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:30.685100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:30.690605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:30.693608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-001d3869-2256-4e93-94d2-9666e6155a48 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.458454 Aug 31 19:21:30.695041 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 283/613] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:30 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:30.796180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:30.799326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:30.800121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:30.806294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.806662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e10c0519-e247-4cc6-b91d-9170c0d7fd47 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1315 microversion: 2.1 time: 0.445604 Aug 31 19:21:30.806775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.807145 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.807925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.808385 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.808950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.821862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 331/614] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:30 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:30.829820 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:30.830875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:30.838567 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.839582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.840390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:30.841894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:30.843368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:30.844316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:31.086576 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:31.096106 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:31.112960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c397d251-80c7-4560-bc23-32631fe649cf tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.317646 Aug 31 19:21:31.113892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 284/615] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:30 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:31.114872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-53976a04-9460-45e7-8283-38cae78a3657 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.291566 Aug 31 19:21:31.115672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 332/616] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:30 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:31.726865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:31.728133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:31.751289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:31.751970 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:31.754591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:31.755538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:31.756016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:31.756449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:31.833878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:31.834490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:31.853680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:31.854622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:31.857135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:31.869771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:31.875648 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:31.882985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.249551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:32.265359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:32.272084 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:32.273709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-519b6fe7-b980-45e0-abd2-3280ded49d29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.552674 Aug 31 19:21:32.274505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 285/617] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:31 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:32.280956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:32.282026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:32.289437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.290321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.291520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.294211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.294950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.295572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.315205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:32.325867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-984af436-5bfa-41e9-a953-b1f50ed16f30 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1464 microversion: 2.1 time: 0.496307 Aug 31 19:21:32.329150 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 333/618] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:31 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1464 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:32.363754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:32.368845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:32.383624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.384412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.387565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.388636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.389276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.395235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.555437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:32.568477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b80e34cd-bd1f-4b49-b501-09c93c2e8c6c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.291963 Aug 31 19:21:32.570544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 286/619] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:32 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:32.590658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:32.595248 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:32.605931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.606990 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.618505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.619274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.619749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.620179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.684560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:21:32.690838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:32.699859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-89424704-f8aa-4a77-b378-e6b2a0961f6a tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.349236 Aug 31 19:21:32.713232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 334/620] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:32 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:32.840633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b7260488-c307-49d5-bc8f-e04d5e19cd4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "DELETE /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 204 len: 0 microversion: 2.1 time: 0.268657 Aug 31 19:21:32.842479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 287/621] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:21:32 2022] DELETE /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:21:32.856617 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:32.857784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:32.874745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.875263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.875714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.876448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.880962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.881433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.946390 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-ca511a58-3a42-45b2-9734-65beb1fe364d req-3d8c650c-0304-4c57-9265-65b7c250dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d389fb4-28b6-4d7e-80bc-fb896c5bf004", "name": "network-vif-plugged", "status": "completed", "tag": "1a01f436-a378-4dc6-a024-41f23bb205d1"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:32.962596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ca511a58-3a42-45b2-9734-65beb1fe364d req-3d8c650c-0304-4c57-9265-65b7c250dbc5 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:32.963074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ca511a58-3a42-45b2-9734-65beb1fe364d req-3d8c650c-0304-4c57-9265-65b7c250dbc5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:32.969963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ca511a58-3a42-45b2-9734-65beb1fe364d req-3d8c650c-0304-4c57-9265-65b7c250dbc5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:32.994450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-ca511a58-3a42-45b2-9734-65beb1fe364d req-3d8c650c-0304-4c57-9265-65b7c250dbc5 service nova] Creating event network-vif-plugged:1a01f436-a378-4dc6-a024-41f23bb205d1 for instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 on hv-cinder-85221 Aug 31 19:21:33.036861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-ca511a58-3a42-45b2-9734-65beb1fe364d req-3d8c650c-0304-4c57-9265-65b7c250dbc5 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081125 Aug 31 19:21:33.036861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 288/622] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:33.209866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:33.219391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9edb254c-2630-483d-ae3b-f06a39d30c95 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.371732 Aug 31 19:21:33.224682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 335/623] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:32 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:33.303702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:33.304328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:33.310726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:33.311216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:33.313351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:33.314079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:33.314535 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:33.314965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:33.507349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:33.517785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:33.519244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:33.522355 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0a96275-3e45-4484-9e2e-67a6c3779c13 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.221082 Aug 31 19:21:33.523137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 289/624] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:33 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:33.597825 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:33.598496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:33.613687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:33.614352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:33.614888 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:33.615923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:33.617097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:33.618391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:33.723502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:33.724121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:33.740714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:33.741220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:33.741664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:33.742355 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:33.742810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:33.743301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:33.886347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:33.899462 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f89d300d-7e69-4acb-a88d-150899288e68 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.306475 Aug 31 19:21:33.900638 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 336/625] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:33 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:33.951671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:33.962550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-237ba75a-b944-43eb-8ba3-88cf76b1155c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.244395 Aug 31 19:21:33.965106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 290/626] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:33 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:34.262934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:34.263993 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:34.271055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.271814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.272529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.273920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.274536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.275128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.280238 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:34.455479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:34.479582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c6d7c075-03cb-4dc9-9549-2152e1278f6d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.224144 Aug 31 19:21:34.492554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 337/627] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:34 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:34.547220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:34.547463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:34.554321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.554824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.555261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.556750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.556750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.557009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.748102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:34.762882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:34.765241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:34.770083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5377912f-5f8e-4749-bec8-232a489a918c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.227731 Aug 31 19:21:34.776462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 291/628] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:34 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:34.923299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:34.924984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:34.942195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.943087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.943633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.944881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.945436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.945965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:34.982952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:34.984550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:34.995009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:34.997240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:34.997998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.002542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.003337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.004002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.284068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:35.295208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:35.296657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c1ea7064-2a51-42fa-9d1b-d67e2b063737 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.317503 Aug 31 19:21:35.310215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 292/629] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:34 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:35.334060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dbb04f49-dc94-4976-bce5-9d7c306e0b18 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.415346 Aug 31 19:21:35.337040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 338/630] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:34 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:35.510476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:35.511236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:35.523461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.524038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.524552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.525376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.526022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.526543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.799944 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:35.800555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:35.816286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.817297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.817912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.824732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:35.825607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:35.826240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:35.876221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:35.886840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fb91f1ae-5385-4a0f-8f2c-008eff93d9d8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.380166 Aug 31 19:21:35.890554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 293/631] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:35 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:36.183865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:36.195920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:36.198088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:36.199555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e4abfc3f-1035-4fe0-9a88-0f019de0a0f8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.404041 Aug 31 19:21:36.217020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 339/632] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:35 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:36.317341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:36.318072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:36.323930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:36.326702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:36.328601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:36.329461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:36.330428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:36.331115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:36.331774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:36.356325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:36.357077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:36.375581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:36.376369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:36.377050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:36.378000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:36.381054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:36.385553 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:36.710097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:36.735443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-65be148a-9191-4d8d-8ef2-3aff6fb053b6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.382803 Aug 31 19:21:36.736043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 340/633] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:36 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:36.825567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:36.840920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fc9f0c34-42a3-425f-888f-c8ad9675811d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.527695 Aug 31 19:21:36.842077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 294/634] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:36 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:36.911949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:36.912555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:36.925805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:36.926300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:36.926739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:36.927457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:36.927908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:36.928326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.195386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:37.207854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-14e42b84-9453-4f9c-a4af-c7c3455b4e87 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.299735 Aug 31 19:21:37.209208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 341/635] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:36 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:37.227798 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:37.228727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:37.241118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:37.241656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:37.242086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.242805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:37.243450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:37.245505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.442388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:37.453694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:37.455959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:37.457380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b516bd90-a61c-4c3a-be2b-731c5a89f6b8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.233655 Aug 31 19:21:37.478494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 295/636] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:37 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:37.762363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:37.762982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:37.770998 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:37.771895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:37.772607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.773405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:37.773934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:37.774582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.865391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:37.866990 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:37.882001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:37.885227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:37.887204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.901643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:37.902131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:37.902576 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:37.929956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:38.031938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:38.050471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b624db7c-33f7-41c0-aebd-51d2c2b4a955 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.290656 Aug 31 19:21:38.061215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 342/637] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:37 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:38.110894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:38.119658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dcc56bc0-4e1d-477a-97fd-f67fba4be1c5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.258676 Aug 31 19:21:38.120911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 296/638] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:37 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:38.230364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:38.230997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:38.238088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:38.238574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:38.239014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:38.239726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:38.240179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:38.241294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:38.410876 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:38.425211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9f905ea7-2fd0-476b-bcc0-643885b695e5 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.198695 Aug 31 19:21:38.426226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 343/639] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:38 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:38.493201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:38.494628 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:38.503723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:38.504362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:38.504846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:38.505697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:38.506158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:38.506586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:38.660594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:38.670345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:38.672622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:38.673877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9fc7db2b-9b7f-4273-89b1-345e4b1ec9af tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.184600 Aug 31 19:21:38.676898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 297/640] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:38 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:39.073390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:39.075678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:39.084513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.085425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.085866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.086561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.087235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.087883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.142974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:39.143865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:39.157642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.158427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.158863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.159570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.160022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.160441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.348430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:39.359813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2b2172f4-2f11-417b-8ef5-acbdc003aff1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.289811 Aug 31 19:21:39.361117 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 344/641] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:39 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:39.381619 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:39.392406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3a475ba2-70dc-4f45-9d5f-27956e29c2c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.254603 Aug 31 19:21:39.414567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 298/642] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:39 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:39.446596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:39.447688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:39.451541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:39.464210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.464860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.465814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.467097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.473750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.474301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.698615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:39.700185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:39.717988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.718719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.720759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.721665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.722268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.724027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.730414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:39.746102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7616410-b2d8-4ef0-853c-6459c3a162f6 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.303299 Aug 31 19:21:39.762976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 345/643] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:39 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:39.937817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-bbf00d70-429e-4ddb-b98e-95a2c48e21de req-a3fe2f20-d537-464c-951b-5e012f84e311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c7d734-295c-4bc0-8233-004d4d31bb36", "name": "network-vif-plugged", "status": "completed", "tag": "bc5bf427-9fc5-46fe-89e3-39dbe7188e00"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:39.948855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-bbf00d70-429e-4ddb-b98e-95a2c48e21de req-a3fe2f20-d537-464c-951b-5e012f84e311 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:39.949320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-bbf00d70-429e-4ddb-b98e-95a2c48e21de req-a3fe2f20-d537-464c-951b-5e012f84e311 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:39.951305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:39.953374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-bbf00d70-429e-4ddb-b98e-95a2c48e21de req-a3fe2f20-d537-464c-951b-5e012f84e311 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:39.962025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:39.963937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:39.965795 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9ca897f5-36b9-4aea-b332-4466ee7e2aa7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.272503 Aug 31 19:21:39.972138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 299/644] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:39 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:39.987018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-bbf00d70-429e-4ddb-b98e-95a2c48e21de req-a3fe2f20-d537-464c-951b-5e012f84e311 service nova] Creating event network-vif-plugged:bc5bf427-9fc5-46fe-89e3-39dbe7188e00 for instance 17c7d734-295c-4bc0-8233-004d4d31bb36 on hv-cinder-85221 Aug 31 19:21:40.005321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-bbf00d70-429e-4ddb-b98e-95a2c48e21de req-a3fe2f20-d537-464c-951b-5e012f84e311 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069279 Aug 31 19:21:40.006310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 346/645] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 31 19:21:40.384204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:40.384769 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:40.393557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:40.394045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:40.394477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:40.398087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:40.398574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:40.399095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:40.418996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:40.421125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:40.435933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:40.437031 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:40.438367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:40.439317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:40.440142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:40.440490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:40.600603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:40.608785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-62f0f5fd-f54d-4595-9c32-d9b6e3650652 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.228773 Aug 31 19:21:40.609373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 300/646] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:40 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:40.630736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:40.638941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7c80d79f-20fd-487e-a2dd-c5ad72c9527d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.228417 Aug 31 19:21:40.643772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 347/647] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:40 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:40.779409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:40.781363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:40.788063 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:40.789181 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:40.789864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:40.790832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:40.791504 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:40.792146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:40.997314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:40.997968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:41.011965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:41.012676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:41.015783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:41.015783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:41.015783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:41.015783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:41.017138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:41.028864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ad8cbf09-fe01-4c4b-9dba-f1823858858f tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.252621 Aug 31 19:21:41.029943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 301/648] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:40 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:41.209192 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:41.221031 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:41.224897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:41.226154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6cf278d4-f528-4d51-8e42-96bea0d57943 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.233326 Aug 31 19:21:41.240623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 348/649] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:40 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:41.630791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:41.631562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:41.639124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:41.640398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:41.641044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:41.641784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:41.642270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:41.642723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:41.659945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:41.661505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:41.674753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:41.675270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:41.675710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:41.676424 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:41.676913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:41.677345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:41.879550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:41.888299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-310ed4fe-f482-4f91-8a44-a33e858f45d1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.261866 Aug 31 19:21:41.913379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 302/650] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:41 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:41.963198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:41.974863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b2729fa8-cce1-44ea-a1e3-13b2f64b9be3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.318607 Aug 31 19:21:41.992173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 349/651] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:41 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:42.052500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:42.053150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:42.059639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.060121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.060539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.061910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.062360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.062781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.228417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:42.238058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ea66bcc9-d36f-480d-9170-f03a18b4e40b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.189212 Aug 31 19:21:42.254331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:42.254677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 303/652] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:42 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:42.254956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:42.267026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.267784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.268229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.269021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.269502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.270254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.281950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5889b4bf-daf4-45a5-96be-123882124378 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Action: 'create', calling method: .version_select at 0x7f975fd6c280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-430805820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2bZwhqyzzeva4OnjsdjbAn8g44klxKKUG5bIHbqcy1IFaAEqSor7GiEJKAdNurcoKnRk/6QbWto67RQND1r5nUzqtiDZ3HT5ez/hMCXEDFJc5akWIoY45x3m10UUca4Q=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:42.300981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-5889b4bf-daf4-45a5-96be-123882124378 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Getting quotas for project a16d7c3be2644b64b9d43e77d9e45804. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:42.307958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-5889b4bf-daf4-45a5-96be-123882124378 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Getting quotas for user 3e8d388698c6493c83f83059727a6188 and project a16d7c3be2644b64b9d43e77d9e45804. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:42.340469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5889b4bf-daf4-45a5-96be-123882124378 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063639 Aug 31 19:21:42.345665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 304/653] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:21:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:42.399823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-793018043", "imageRef": "24296d49-0a1b-4bf1-979a-5bcce5a70b3c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-430805820", "networks": [{"uuid": "5eeb52ea-e391-4b2e-bd91-1b4a5351ed49"}]}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:42.438714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:42.453602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:42.455346 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:42.457193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d8406cd1-12a2-4a83-8b2e-c6ac605189b9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.206400 Aug 31 19:21:42.457953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 350/654] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:42 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:42.465991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] validate_networks() for [('5eeb52ea-e391-4b2e-bd91-1b4a5351ed49', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:21:42.855635 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:21:42.856054 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:21:42.856671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:21:42.857076 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:21:42.857478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:21:42.866879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.867351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.867777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.868871 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.869332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.869753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.887805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Getting quotas for project a16d7c3be2644b64b9d43e77d9e45804. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:21:42.894212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Getting quotas for user 3e8d388698c6493c83f83059727a6188 and project a16d7c3be2644b64b9d43e77d9e45804. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:21:42.907930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:21:42.910818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='24296d49-0a1b-4bf1-979a-5bcce5a70b3c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:21:42.911218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:42.911780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:42.921017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.922080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.922617 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.923416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:42.923977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:42.924686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:42.965535 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5a5d7474-fe80-4f6d-a67e-594dd36d849e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569551 Aug 31 19:21:42.966523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 305/655] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:21:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 19:21:42.982588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c831bf06-b5a8-4b65-9c73-548adb093130 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:42.983428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c831bf06-b5a8-4b65-9c73-548adb093130 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.055003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c831bf06-b5a8-4b65-9c73-548adb093130 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.066407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c831bf06-b5a8-4b65-9c73-548adb093130 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1257 microversion: 2.1 time: 0.089648 Aug 31 19:21:43.067380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 306/656] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:42 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1257 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:43.072900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:43.073697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.084377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.085208 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.085869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.087692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.088342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.089156 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.448151 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.457593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-34375209-4447-401e-89fc-292d52783ea0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.550310 Aug 31 19:21:43.458419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 351/657] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:42 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:43.463552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:43.464358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.471766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.472279 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.472714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.473417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.474127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.474720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.502729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.511003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8df55243-14d2-46bc-b100-1853e2625ee8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.442514 Aug 31 19:21:43.521201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 307/658] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:43 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:43.531297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:43.531841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:43.538700 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.539189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.539733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.540457 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:43.541020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:43.541445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:43.681696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.690535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4adf47a9-0220-44ea-b70f-fea747dd1c57 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.230649 Aug 31 19:21:43.691142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 352/659] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:43 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:43.733175 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.742752 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.744524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:43.745804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2fc7f811-aea7-450a-8aeb-4681a0e7356d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.218827 Aug 31 19:21:43.746822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 308/660] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:43 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:44.087221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.087841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.095067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.095527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.095958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.096676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.097131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.097554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.187672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.197182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-51edf855-4483-47ca-959c-c63119c90d7e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1261 microversion: 2.1 time: 0.113689 Aug 31 19:21:44.197758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 353/661] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1261 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:44.478957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.480314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.487794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.488281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.488751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.489462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.489913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.490335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.534674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.535376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.542565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.543042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.543470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.544226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.544711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.545208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.566488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:44.675944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.684282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2937375d-5ee5-4a23-a4a5-ff2dc3fcc278 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.209313 Aug 31 19:21:44.685124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 309/662] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:44.713857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.714655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.719439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.722175 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.722788 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.723573 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.724549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.725280 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.729126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bf6e3c21-ad7d-41b0-b5d3-ee8c1f7a0af7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.198194 Aug 31 19:21:44.729979 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 354/663] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:44.740265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.769887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:44.770759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:44.776968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.777467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.777907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.778624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:44.779083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:44.779713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:44.937510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.955320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-99440c0f-7c57-47cf-8393-b8fd0a8e9b4b tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.236394 Aug 31 19:21:44.956116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 310/664] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:44.966881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.977090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.978858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:44.980124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ecd37309-c40f-4bd0-89e0-c85f8deef1e9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.214422 Aug 31 19:21:44.981319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 355/665] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:44 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:45.220004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:45.220648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:45.226667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.227146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.227571 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.228255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.228800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.229233 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.291446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:45.300625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2aa781e0-77ca-48c8-8d67-f1157ee38c91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1261 microversion: 2.1 time: 0.085048 Aug 31 19:21:45.301231 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 311/666] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:45 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:45.707662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:45.708359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:45.715240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.715716 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.716149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.716902 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.717957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.718384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.750575 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:45.751450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:45.758151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.758791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.759314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.760114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.760693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.761209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.934052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:45.942541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cddefe93-9b4a-4be0-9ba3-1006079b5eee tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.240039 Aug 31 19:21:45.945741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:45.953931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1ca3bf21-3004-40ad-b0ed-f9246153cee1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.207101 Aug 31 19:21:45.956624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 312/667] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:45 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:45.969813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 356/668] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:45 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:45.978386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:45.978998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:45.985919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.986634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.987078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:45.987964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:45.988500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:45.989149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.003236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:46.003842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:46.016644 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.017167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.017579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.018510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.018750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.019188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.223170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:46.231867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-83ad0125-30a3-475f-95f5-8328ef20830d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.257211 Aug 31 19:21:46.236615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 313/669] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:45 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:46.249193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:46.257615 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:46.259058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:46.260221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c63f2a0b-1944-4fea-b692-84f1a0bb7e36 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.260830 Aug 31 19:21:46.260806 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 357/670] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:45 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:46.321215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:46.321943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:46.328812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.329289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.329717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.330406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.330848 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.331265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.394476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:46.402366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-08e1bc8d-7d34-4226-b538-0023848aa047 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1261 microversion: 2.1 time: 0.084908 Aug 31 19:21:46.402931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 314/671] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:46 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:46.975926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:46.976793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:46.978189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:46.978737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:46.985195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.985625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.985746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.986186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.986295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.986636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.986925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.987331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:46.987435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.987816 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:46.987929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:46.988197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.205787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.209037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.212456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:47.214246 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f04453c5-2c84-46d7-ad79-af19b97fd126 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.242620 Aug 31 19:21:47.214950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 358/672] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:46 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:47.218351 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1e66f901-a02d-4f99-8146-e95dd6d90aa0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.243945 Aug 31 19:21:47.218957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 315/673] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:46 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:47.255578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:47.256202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:47.262907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.263346 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.263780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.264524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.264998 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.265417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.284847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:47.285549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:47.298638 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.299263 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.299801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.300593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.301131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.301630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.479982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.483199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.489206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-37203929-6441-4cce-9f8b-35f34a6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.237406 Aug 31 19:21:47.489783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 359/674] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:47 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:47.492249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.493732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.494451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:47.494883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-74823afc-c132-48b2-b672-f642ac478fc0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.215086 Aug 31 19:21:47.495060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:47.502973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.503514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.504002 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.504781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:47.505102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 316/675] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:47 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:47.505420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:47.505943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:47.570442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:47.578277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-06246b03-47c4-4066-8f25-a38b827bab81 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1261 microversion: 2.1 time: 0.087513 Aug 31 19:21:47.578847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 360/676] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:47 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:48.236229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:48.236840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:48.238674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:48.239477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:48.245954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.246821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.247619 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.248889 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.249727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.249863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.250494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.250659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.251399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.252426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.253100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.253525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.447170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.450390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.455899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-64b9bd0e-b914-4472-99cb-bfafc179f2af tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.223764 Aug 31 19:21:48.456472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 317/677] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:48 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:48.458678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6b0c3ba9-01b6-47fe-868d-e97b7587559e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.223749 Aug 31 19:21:48.459227 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 361/678] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:48 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:48.510875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:48.511505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:48.518225 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.518711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.518830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:48.519146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.519499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:48.519841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.520300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.520753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.525309 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.525780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.526208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.526883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.527328 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.527748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.717675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.726636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.726824 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.728302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.729489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-675d5e96-2504-48ec-aecc-fd0ce923ee9b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.215377 Aug 31 19:21:48.730254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 362/679] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:48 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:48.734775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:48.735407 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:48.736192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d88bd3c7-2909-48d2-ae60-b32826502507 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1470 microversion: 2.1 time: 0.229014 Aug 31 19:21:48.738726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 318/680] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:48 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:48.742175 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.743286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.744003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:48.744457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:48.744920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:48.815058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:48.824502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-70b62430-e8a4-42db-9f28-6be85653144f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1261 microversion: 2.1 time: 0.093157 Aug 31 19:21:48.825410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 363/681] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:48 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:49.299632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-07664800-4a79-4ee0-8abb-447de4217017 req-94e0167e-3ebe-40fa-baa8-759eb54c4863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bbe0cb-0063-4409-968c-0d6001b17802", "name": "network-vif-deleted", "tag": "c77c0bc0-95cf-469d-9e2d-6e371298afe9"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:49.309591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-07664800-4a79-4ee0-8abb-447de4217017 req-94e0167e-3ebe-40fa-baa8-759eb54c4863 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.310069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-07664800-4a79-4ee0-8abb-447de4217017 req-94e0167e-3ebe-40fa-baa8-759eb54c4863 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.310496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-07664800-4a79-4ee0-8abb-447de4217017 req-94e0167e-3ebe-40fa-baa8-759eb54c4863 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.323473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-07664800-4a79-4ee0-8abb-447de4217017 req-94e0167e-3ebe-40fa-baa8-759eb54c4863 service nova] Creating event network-vif-deleted:c77c0bc0-95cf-469d-9e2d-6e371298afe9 for instance 89bbe0cb-0063-4409-968c-0d6001b17802 on hv-cinder-85221 Aug 31 19:21:49.328881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-07664800-4a79-4ee0-8abb-447de4217017 req-94e0167e-3ebe-40fa-baa8-759eb54c4863 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036381 Aug 31 19:21:49.329474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 319/682] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:49.478339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.479172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:49.480955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.481647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:49.486063 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.486554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.487000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.487645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.487760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.488121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.488270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.488544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.488691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.489253 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.489695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.490108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.689865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.692957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.697760 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c52c822c-592c-4178-8e99-058028c98d40 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.221566 Aug 31 19:21:49.698339 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 320/683] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:49 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:49.701198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-82cb69eb-b459-4b9c-bfcd-a43fe033d560 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.226693 Aug 31 19:21:49.702558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 364/684] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:49 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:49.753650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.754257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:49.757645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.758384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:49.760497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.761021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.761676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.762147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.762599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.763023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.765372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.765941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.766578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.767291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.767753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.768182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.845703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.853442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f3044143-c1dc-4468-aaab-19893e53c80e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1428 microversion: 2.1 time: 0.099530 Aug 31 19:21:49.854011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 365/685] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:49 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:49.859000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:49.859329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:49.865177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.865666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.866100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.866798 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:49.867247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:49.867676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:49.944253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.958307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d126d652-119b-48e2-b371-3983600b3c24 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.101196 Aug 31 19:21:49.958739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 366/686] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:49 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:49.977512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.986768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.988222 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:49.989399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-977460f7-8b47-4037-a66a-72d73be869db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.239860 Aug 31 19:21:49.989945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 321/687] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:49 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:50.721262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:50.721899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:50.722802 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:50.723479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:50.729774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.729936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.730223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.730394 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.730705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.730815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.731443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.731559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.731899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.732008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.732326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.732425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.926449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:50.930857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:50.935003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-55dd8b0e-dc3d-445b-b78c-6aa3c10ded77 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.215881 Aug 31 19:21:50.935569 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 322/688] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:50 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:50.938453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b621c194-1339-4c35-8cde-f8771e790bd8 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.222454 Aug 31 19:21:50.939153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 367/689] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:50 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:50.941038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:50.941647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:50.947754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.948891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.949556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.950158 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.950615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.951039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.979676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:50.980199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:50.983740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.984409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.984700 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.985147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:50.986671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.987170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.987599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:50.988286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:50.988838 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:50.989267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.027095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:51.036405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0cdbd993-ac65-4875-a430-c9d3fe745b4e tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.099409 Aug 31 19:21:51.037011 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 323/690] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:50 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:51.043305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:51.043987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:51.050747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.051296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.051794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.052546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.053025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.053445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.057839 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:51.066869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-287af0b6-dc9e-4883-bf1a-3611f62e3fe3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.090960 Aug 31 19:21:51.067442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 368/691] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:50 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:51.183592 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:51.192932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:51.194409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:51.195817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3141616d-ed87-4e51-b8ae-3c3126303e7d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.156127 Aug 31 19:21:51.196446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 324/692] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:51 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:51.956045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:51.956597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:51.959116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:51.959726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:51.963051 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.963525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.963980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.964708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.965463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.965624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.965895 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.966383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.966813 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:51.968249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:51.968703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:51.969132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.160561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.164021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.168688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bcd80e03-e986-4c11-8366-4310fe42dc4f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.216518 Aug 31 19:21:52.169268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 369/693] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:51 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:52.172888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b5016d59-837b-4097-a2f9-d8c981a0e353 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1318 microversion: 2.1 time: 0.217461 Aug 31 19:21:52.173590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 325/694] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:51 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:52.174742 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:52.175345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:52.178219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:52.178532 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:52.184193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.184708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.185332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.186583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.187234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.187667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.188254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.188870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.189320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.190018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.190697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.191136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.222875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.223320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.223755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.224201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:52.252718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.260361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-79a65e08-614d-4923-b577-bda4ee3c9a91 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.085853 Aug 31 19:21:52.260958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 326/695] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:52 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:52.267505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:52.268622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:52.277654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.278535 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.279331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.280700 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:52.282045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:52.282821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:52.289081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.292762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:52.298732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-73836853-48ed-4464-a33c-2af1d3a01a63 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.128458 Aug 31 19:21:52.299308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 370/696] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:52 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:52.419630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.428656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.430114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:52.431238 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fa05336b-2bfe-43fa-97fd-0f3e9fa5d785 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.169375 Aug 31 19:21:52.431793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 327/697] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:52 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:53.191303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:53.191931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:53.198049 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:53.198619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.198735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:53.199092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.199518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.200211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.200589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:53.200877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.201307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.201446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=12 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:53.206940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.207418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.207850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.208544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.209020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.209440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.392764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.396995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.400541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0609880c-be33-4426-8f61-0edcf98a99ee tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1370 microversion: 2.1 time: 0.213150 Aug 31 19:21:53.401141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 371/698] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:53 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:53.405460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-94e01f80-b486-4e7a-ac64-9d73ceedafd1 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1506 microversion: 2.1 time: 0.211212 Aug 31 19:21:53.406202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 328/699] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:53 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:53.406676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:53.407298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:53.413540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.414024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.414463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.415164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.415610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.416030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.420993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:53.422528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:53.425688 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:53.429603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.431244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.431244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.431244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.431808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.432221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.472070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.472554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.473009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.473453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:53.482467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.495020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b6e7396b-158e-4cd7-ae28-6f8f0ae52ad1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.090584 Aug 31 19:21:53.495020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 372/700] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:53 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:53.500910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:53.501611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:53.507651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.508214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.508767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.509534 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:53.510058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:53.510552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:53.520653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.534310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-efec4a0f-77cd-4a57-aeb1-0782e876fe48 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.117800 Aug 31 19:21:53.535011 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 329/701] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:53 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:53.656847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.665688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.667123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:53.668259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ceceac7-f301-4026-9c3a-d647a30ecb6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.172329 Aug 31 19:21:53.668845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 373/702] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:53 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:54.423607 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.424118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.430012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.430491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.430927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.431608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.432057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.432522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.519353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.521329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.534020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.534896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.535688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.537226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.538037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.538955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.581695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:54.589795 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0dacaf87-40d4-45c4-a36f-10e08ef585c0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1563 microversion: 2.1 time: 0.170531 Aug 31 19:21:54.590540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 330/703] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:54.595331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.595939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.602589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.603332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.604013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.605031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.605654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.606087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.617588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:54.625732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-83e3bb4b-bac4-4968-9de7-7309ca2582a5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.114512 Aug 31 19:21:54.635748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 374/704] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:54.635748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.635748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.637800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.638497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.639820 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.640784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.641397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.641993 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.657116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.657892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.658686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.659191 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:54.726441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:54.734970 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c819b453-acb7-465d-b2ad-fd7bb475cc3d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.143331 Aug 31 19:21:54.735556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 331/705] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:54.746544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-880d5e20-bfc2-4ae7-99f6-a37de7137b3b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118839 Aug 31 19:21:54.747386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 375/706] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:21:54.750148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:54.750759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:54.756868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.757353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.757785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.758474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:54.758927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:54.759426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:54.764893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:21:54.994482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.003637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.005092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.006235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aa03231c-fa0b-4188-a3e9-910033a4f39b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.260602 Aug 31 19:21:55.006786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 332/707] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:54 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:55.649093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:55.649690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:55.656270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.656929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.657636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.658387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.659063 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.659675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.753045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.757754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:55.758646 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:55.763002 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cd51823c-f131-4534-ae36-b8a6ad03483a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.118159 Aug 31 19:21:55.771147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 376/708] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:55 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:55.771463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.771463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.771463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.771463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.771794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.771794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.802379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.802857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.803489 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.803919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:55.822802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-6c7afbf9-fc13-424c-bab0-51c145202aed req-40f8b7d6-9732-4dc0-bfee-21f612b846ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d389fb4-28b6-4d7e-80bc-fb896c5bf004", "tag": "1a01f436-a378-4dc6-a024-41f23bb205d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:21:55.832556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6c7afbf9-fc13-424c-bab0-51c145202aed req-40f8b7d6-9732-4dc0-bfee-21f612b846ec service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:55.833047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6c7afbf9-fc13-424c-bab0-51c145202aed req-40f8b7d6-9732-4dc0-bfee-21f612b846ec service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:55.833472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-6c7afbf9-fc13-424c-bab0-51c145202aed req-40f8b7d6-9732-4dc0-bfee-21f612b846ec service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:55.847650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:55.848339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-6c7afbf9-fc13-424c-bab0-51c145202aed req-40f8b7d6-9732-4dc0-bfee-21f612b846ec service nova] Creating event network-changed:1a01f436-a378-4dc6-a024-41f23bb205d1 for instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 on hv-cinder-85221 Aug 31 19:21:55.853643 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-6c7afbf9-fc13-424c-bab0-51c145202aed req-40f8b7d6-9732-4dc0-bfee-21f612b846ec service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034420 Aug 31 19:21:55.855365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f07c578d-e61d-439f-b277-435b19d0c596 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.101338 Aug 31 19:21:55.856305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 333/709] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:55 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:21:55.858382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 377/710] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:21:56.030747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:56.031707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:56.038506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.038997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.039430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.040132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.040609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.041041 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.179026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:56.188367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:56.189935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:56.191182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-818d73e6-b02e-408e-a756-dcd135b4239b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.164933 Aug 31 19:21:56.191818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 334/711] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:56 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:56.798142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:56.798924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:56.805468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.806042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.806548 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.807324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.807849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.808364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.876562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:56.878308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:56.878968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:56.885110 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb5681e4-47c9-4ffd-82e6-ba0641786064 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.091816 Aug 31 19:21:56.885391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.885659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 378/712] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:56 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:56.885872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.886362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.887123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.887591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.888058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.921926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:56.922407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:56.922832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:56.923271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:56.964117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:56.971933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-49a4f11a-6804-445d-9ac8-55890f15ed09 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.097633 Aug 31 19:21:56.972487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 335/713] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:56 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:57.214900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:57.215533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:57.221647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:57.222121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:57.222703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:57.223631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:57.224079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:57.224499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:57.362900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:57.371493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:57.372968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:57.374763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7ea151d1-ffda-4d18-b01b-78b4569d4eae tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.163842 Aug 31 19:21:57.375512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 379/714] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:57 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:21:57.911539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:57.912137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:57.918111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:57.918579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:57.919002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:57.919671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:57.920113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:57.920532 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:57.984722 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:57.992750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-329bee42-836c-4f19-b26b-5fcd3a2fbf1e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.085157 Aug 31 19:21:57.993828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 336/715] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:57 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:57.998143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:57.998880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:58.005426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.005835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.006267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.006961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.007406 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.007826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.039165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.039633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.040056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.040487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:58.081198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:58.088707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dcd0eafd-6f24-4b12-8dc6-eb7a2bddcdc4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.098049 Aug 31 19:21:58.089257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 380/716] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:57 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:58.397706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:58.398216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:58.404094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.404583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.405061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.405748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:58.406187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:58.406600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:58.541615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:58.550304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:58.551761 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:58.552961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ff400e47-ad05-43d6-b88e-20067121f15a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.159160 Aug 31 19:21:58.553535 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 337/717] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:58 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:21:59.015274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:59.015905 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:59.022457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.022985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.023417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.024390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.024894 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.025317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.090265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:59.099453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e4ecfe55-f561-42af-a5d6-0a14b5d02049 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.088889 Aug 31 19:21:59.099818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 381/718] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:59 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:59.109709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:59.110663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:59.116771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.117343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.117869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.118574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.119027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.119521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.165006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.165482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.165911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.166344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:21:59.206385 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:59.214459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2f01e45c-bd77-4b2d-81dc-895c054a6d80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.109192 Aug 31 19:21:59.215038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 338/719] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:21:59 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:21:59.575403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:21:59.575986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:21:59.582598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.583070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.583496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.584439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:21:59.585148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:21:59.585730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:21:59.720659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:59.729929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:59.731360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:21:59.732585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-71e689bb-4cb7-4382-a99a-9b9b471a70d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.161062 Aug 31 19:21:59.733283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 382/720] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:21:59 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:00.120173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:00.120809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:00.128403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.128916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.129353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.130050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.130502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.130923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.193561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:00.201389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1a8423ee-4ae5-4aea-871a-f5d713cd3e06 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.085043 Aug 31 19:22:00.202744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 339/721] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:00 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:00.236198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:00.236854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:00.243417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.243900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.244331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.245071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.245528 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.245951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.281175 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.281651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.282083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.282527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:00.325875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:00.335845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2840d9ab-3bc1-4993-ae6c-7b5478f4c6d4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.102733 Aug 31 19:22:00.336445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 383/722] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:00 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:00.756470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:00.757120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:00.763048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.763526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.763961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.764699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:00.765202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:00.765717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:00.897003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:00.907371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:00.908836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:00.909989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-923df2c7-76ec-45e5-af15-271e5b5fa2cd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.157492 Aug 31 19:22:00.910553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 340/723] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:00 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:01.223046 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:01.223740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:01.230026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.230535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.230965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.231647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.232099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.232513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.297268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:01.305063 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-28d2159f-eefd-4059-a7e3-27513defc482 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1253 microversion: 2.1 time: 0.085900 Aug 31 19:22:01.305635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 384/724] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:01 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:01.357828 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:01.358940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:01.365143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.365757 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.366286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.367050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.367754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.368245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.401926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.402426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.402844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.403284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:01.449157 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:01.458661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9e44d6e5-ecde-4f28-b1b4-416dc6c11084 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.104628 Aug 31 19:22:01.459229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 341/725] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:01 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:01.933952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:01.934550 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:01.941340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.941820 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.942257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:01.942945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:01.943401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:01.943826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.075934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:02.085071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:02.086491 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:02.087624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cd696fcf-899f-4f5f-9a34-6be684b63e65 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.157660 Aug 31 19:22:02.088176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 385/726] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:01 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:02.326441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:02.327512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:02.333649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:02.334128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:02.334560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.335241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:02.335693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:02.336114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.409209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:02.417087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eee16ebe-cd70-4334-98f3-515e26ce0e3d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1309 microversion: 2.1 time: 0.094674 Aug 31 19:22:02.417643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 342/727] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:02 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:02.479802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:02.480442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:02.487043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:02.487518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:02.487947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.488684 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:02.489121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:02.489540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.521488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:02.522070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:02.522513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:02.522955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:02.564176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:02.572594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ab4db3e8-ce13-41b1-92e5-58dddc4b4bef tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.096575 Aug 31 19:22:02.573257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 386/728] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:02 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:03.114705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:03.115422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:03.122256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.122825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.123595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.125104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.125635 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.126151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.271377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:03.280434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:03.281910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:03.283182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-15d10d47-2b71-4082-a80b-99581029b72a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.172824 Aug 31 19:22:03.283725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 343/729] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:03 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:03.439386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:03.439993 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:03.446003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.446479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.446909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.447588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.448037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.448469 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.468147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:03.512027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:03.520591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a939761e-80c8-4e85-b260-81d7e0d0f9d9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1309 microversion: 2.1 time: 0.085835 Aug 31 19:22:03.521181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 387/730] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:03 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:03.596612 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:03.597188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:03.603204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.603693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.604126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.604846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.605299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.605723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.639294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:03.640015 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:03.640459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:03.640944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:03.689542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:03.697396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-47080653-1e2f-49e7-86b0-fcb19b0bd673 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.104803 Aug 31 19:22:03.698046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 344/731] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:03 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:04.313135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:04.314040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:04.323382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.323873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.324310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.325656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.325837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.328479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.542820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:04.543834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:04.552736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.553512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.554104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.554984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.555603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.556187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.589519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:04.614626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:04.616639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:04.621371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b00a661f-06f1-4447-89e1-3cecee362005 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.318754 Aug 31 19:22:04.626645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 388/732] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:04 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:04.640601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:04.653650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4222e5ed-a7b0-41e1-ac06-c1016fd91bd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1315 microversion: 2.1 time: 0.115708 Aug 31 19:22:04.654319 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 345/733] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:04 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1315 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:04.724917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:04.727498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:04.749156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.749783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.750243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.750975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.751435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.751865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.790220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:04.790968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:04.791600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:04.792205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:04.836496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:04.845817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6e65a839-7d3f-4298-935d-e3011042bb61 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.130937 Aug 31 19:22:04.859924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 389/734] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:04 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:05.653296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:05.653905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:05.660173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:05.660950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:05.661389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:05.662083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:05.662537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:05.662962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:05.675400 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:05.676090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:05.681478 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:05.684434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:05.686778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:05.686778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:05.686778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:05.687290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:05.687436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.140956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:06.150120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:06.151356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:06.151550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:06.152774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-176fd8b3-a425-47ca-9d4f-68ac4bed2646 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.503502 Aug 31 19:22:06.153305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 346/735] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:05 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:06.159050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:06.159652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:06.159961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fcc56a29-892c-4288-85cf-d73cbbbd38f4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.488577 Aug 31 19:22:06.160524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 390/736] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:05 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:06.166063 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:06.166547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:06.166979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.167668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:06.168109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:06.168668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.173176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:06.204915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:06.205389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:06.205826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.206258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:06.250636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:06.258675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-53cd34ff-338a-4c68-a374-7363a07fa813 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.104045 Aug 31 19:22:06.259255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 347/737] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:06 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:06.439332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-cfc910ed-b5b9-40aa-87ce-25497dff0468 req-96cac68b-68a6-4699-b875-872c9edee1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "name": "network-vif-plugged", "status": "completed", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:06.459024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-cfc910ed-b5b9-40aa-87ce-25497dff0468 req-96cac68b-68a6-4699-b875-872c9edee1e0 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:06.460001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-cfc910ed-b5b9-40aa-87ce-25497dff0468 req-96cac68b-68a6-4699-b875-872c9edee1e0 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:06.461023 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-cfc910ed-b5b9-40aa-87ce-25497dff0468 req-96cac68b-68a6-4699-b875-872c9edee1e0 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:06.483037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-cfc910ed-b5b9-40aa-87ce-25497dff0468 req-96cac68b-68a6-4699-b875-872c9edee1e0 service nova] Creating event network-vif-plugged:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:22:06.492309 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-cfc910ed-b5b9-40aa-87ce-25497dff0468 req-96cac68b-68a6-4699-b875-872c9edee1e0 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057840 Aug 31 19:22:06.494103 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 391/738] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:07.177537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:07.178348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:07.184652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.185044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:07.185766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:07.185975 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.187148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.188163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.189052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.189783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.193103 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.193591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.194029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.194740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.195191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.195790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.404462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:07.409378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:07.416198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:07.417774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:07.419081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-79f3fe1b-75c3-42f7-a730-cde2e85c26e7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.245445 Aug 31 19:22:07.420146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 348/739] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:07 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:07.423245 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a41818ec-eed5-4af9-85ca-fb9dfc02d10d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.243764 Aug 31 19:22:07.424084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 392/740] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:07 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:07.425335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:07.425945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:07.431837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.432315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.432892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.433977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.434775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.435533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.476698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:07.477180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:07.477614 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:07.478055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:07.528039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:07.537960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-af2ded17-964e-4e90-aed5-2a25111dee80 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.116494 Aug 31 19:22:07.538562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 349/741] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:07 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:08.446688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:08.447322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:08.447691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:08.447775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:08.451450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.452290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.452537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.453200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.454069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.454465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.454791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.455190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.455308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.455651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.455766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.456081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.664165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:08.675533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-da9f7068-7210-484d-b5ff-701bdc09fcdc tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.235338 Aug 31 19:22:08.676746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 393/742] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:08 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:08.683801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:08.689388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:08.693939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:08.699349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:08.704872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.707103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:08.708246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2f3c380-7afe-4611-a4da-38e4082a0ac8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.268212 Aug 31 19:22:08.708831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 350/743] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:08 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:08.709489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.710157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.711126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.711768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.712362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.755088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:08.755580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:08.756017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:08.756472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:08.802414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:08.810493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-100a1873-cd25-4a9a-9718-17b93c1ea76d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.132670 Aug 31 19:22:08.811251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 394/744] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:08 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:09.698050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:09.698613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:09.705375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:09.705860 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:09.706294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:09.706985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:09.707437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:09.707862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:09.734447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:09.735628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:09.753564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:09.754060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:09.754504 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:09.755217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:09.755680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:09.756233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:09.941107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:09.950583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:09.951935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:09.953833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8a32e25e-542f-42da-8e7e-a8445381fe27 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.225358 Aug 31 19:22:09.954512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 395/745] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:09 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:09.958961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:09.959556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:09.961003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:09.966804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:09.967256 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:09.969541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:09.971720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:09.971720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:09.971720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:09.975134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0bb1d490-1e57-4659-9d50-57178384c48b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.281030 Aug 31 19:22:09.977154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 351/746] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:09 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:10.013208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:10.013676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:10.014102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:10.014646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:10.058939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:10.067946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb31dc59-fda0-4fd3-8bd2-7bfa8f6475fa tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.112154 Aug 31 19:22:10.074371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 396/747] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:09 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:10.976529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:10.977212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:10.984282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:10.984814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:10.985714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:10.986566 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:10.987023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:10.993126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:11.000487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:11.001151 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:11.007528 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:11.008007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:11.008440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:11.009164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:11.009619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:11.010042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:11.234192 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:11.236288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:11.242877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ba0404d-2fbe-4069-9e01-254c2bdd9185 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.247464 Aug 31 19:22:11.243541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 397/748] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:10 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:11.245310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:11.246777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:11.248239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8c7f204a-7fa9-43d6-96cc-0284140012e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.275620 Aug 31 19:22:11.248420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:11.249663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 352/749] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:10 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:11.249900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:11.256359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:11.256956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:11.257459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:11.258160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:11.258609 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:11.259032 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:11.290794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:11.291280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:11.291718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:11.292166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:11.333583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:11.341217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-874af26c-585a-4368-aee6-7b00eaae166c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.096540 Aug 31 19:22:11.341775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 398/750] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:11 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:12.265493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:12.266232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:12.272102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:12.272716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.273071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.273543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.274171 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:12.274905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.275362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.275842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.286075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.286929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.287577 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.288512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.289288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.289938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.498983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:12.505689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:12.509331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4b2c4cd5-3055-411a-829d-d3afbde165fa tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.247563 Aug 31 19:22:12.510098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 353/751] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:12 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:12.520045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:12.522093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:12.523378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0d36f4e5-33d4-4234-9eb9-c527f50c3203 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.255520 Aug 31 19:22:12.524162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 399/752] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:12 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:12.525066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:12.525669 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:12.532744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.533218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.533645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.534327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.534772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.535188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.571320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:12.571870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:12.572298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:12.572786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:12.619298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:12.627871 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fa425ba8-3c25-4670-8ccc-ce3390b6ee5c tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.107006 Aug 31 19:22:12.628451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 354/753] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:12 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:13.532018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:13.533147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:13.540964 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.541451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.541888 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.542912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.543473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.543897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.547925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:13.548689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:13.554931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.555493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.556024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.556840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.557363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.557862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.756713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:13.764406 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2c0b10b7-144a-43b6-9f50-c57a3402aa50 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.237119 Aug 31 19:22:13.770489 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:13.770702 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 400/754] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:13 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:13.775463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:13.776076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:13.781098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:13.782521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:13.782688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.783175 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.783610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.783713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-86e01e7f-5b45-4308-a4e1-54b4bdb0d58d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.239834 Aug 31 19:22:13.784224 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 355/755] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:13 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:13.784366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.784780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.785209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.819176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:13.819658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:13.820107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:13.820557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:13.863243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:13.870881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4d05040e-6173-4831-a445-adbcf8677b77 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.099190 Aug 31 19:22:13.871445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 401/756] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:13 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:14.787144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:14.787824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:14.793947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:14.794432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:14.794847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:14.795559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:14.796825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:14.797247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:14.806875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:14.808137 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:14.815744 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:14.816510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:14.817167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:14.818054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:14.818670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:14.819255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:15.012717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:15.022469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2124c5e-e19f-4fcc-9426-4c498922ae02 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.239285 Aug 31 19:22:15.033598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 356/757] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:14 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:15.038954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:15.039572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:15.045163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:15.045849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:15.046452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:15.046964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:15.047773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:15.048440 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:15.048836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:15.056783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:15.068504 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:15.069840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-837150f1-9c52-41e9-8ea5-0da21b06bed8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.266715 Aug 31 19:22:15.086905 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 402/758] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:14 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:15.105822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:15.106439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:15.106948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:15.107480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:15.157654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:15.165699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-85774812-de07-4abd-878b-90ccffcfc9b4 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.130853 Aug 31 19:22:15.166409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 357/759] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:15 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:16.046336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:16.047194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:16.054920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.055465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.055831 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.056543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.057020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.057444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.062781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:16.099856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:16.100638 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:16.111751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.112253 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.112731 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.113452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.113902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.114327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.258225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:16.266449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-67b60c4e-02ce-4b98-98e5-3ab4371bf8b1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.224342 Aug 31 19:22:16.267025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 403/760] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:16 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:16.271616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:16.272218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:16.278071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.278546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.278983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.279685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.280795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.281169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.317293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:16.318427 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:16.318918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:16.319387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:16.319801 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:16.336681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:16.338118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:16.339271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-307b0d51-18c5-4dd5-b4f4-2d98264d35bd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.243838 Aug 31 19:22:16.339837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 358/761] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:16 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:16.366289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:16.379575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-87819ea5-a9ac-493d-899f-069eed99313d tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.111287 Aug 31 19:22:16.385592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 404/762] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:16 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:17.287925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:17.288770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:17.294486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.294984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.295471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.296211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.296692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.297167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.364077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:17.364856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:17.371395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.372002 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.372664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.373292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.373751 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.374414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.466415 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:17.474326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8f241cee-ca93-4ff2-af0e-580e61c3a916 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.190580 Aug 31 19:22:17.475032 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 359/763] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:17 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:17.492251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:17.492893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:17.498821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.499307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.499737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.500436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.500923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.501345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.534469 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:17.534651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:17.534956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:17.535670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:17.536114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lazy-loading 'fault' on Instance uuid 89bbe0cb-0063-4409-968c-0d6001b17802 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:17.544262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:17.545816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:17.546938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-59e97bc4-7022-49a2-9c34-e88c64204abf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.187070 Aug 31 19:22:17.548843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 405/764] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:17 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:17.584885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5efa16ebc44403b8382ecc784e1eddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f01988234948f18e7182e829cbcf0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:17.597740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-94fe1f7d-c4c7-4980-b9bc-07020ce7c6f8 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 200 len: 1305 microversion: 2.1 time: 0.109133 Aug 31 19:22:17.598612 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 360/765] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:17 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:18.328778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a12b190-5f40-4436-8c91-71279ceeba0e", "device": "/dev/sdb"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:18.331934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:18.338746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.339574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.340184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.341127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.341760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.342424 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.360087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-7034bb3d-80c5-434e-afa0-81e8b6ec8231 req-9e2116c9-77cb-4d47-b739-584e6b438c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:18.378403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7034bb3d-80c5-434e-afa0-81e8b6ec8231 req-9e2116c9-77cb-4d47-b739-584e6b438c49 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.378886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7034bb3d-80c5-434e-afa0-81e8b6ec8231 req-9e2116c9-77cb-4d47-b739-584e6b438c49 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.379311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7034bb3d-80c5-434e-afa0-81e8b6ec8231 req-9e2116c9-77cb-4d47-b739-584e6b438c49 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.393879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-7034bb3d-80c5-434e-afa0-81e8b6ec8231 req-9e2116c9-77cb-4d47-b739-584e6b438c49 service nova] Creating event network-changed:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:22:18.399101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-7034bb3d-80c5-434e-afa0-81e8b6ec8231 req-9e2116c9-77cb-4d47-b739-584e6b438c49 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043044 Aug 31 19:22:18.399772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 361/766] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:18.495798 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:18.496495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:18.502967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.503717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.504451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.504886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.505339 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.505764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.672887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:18.678707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:18.692161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d6dbf8f5-059e-4dd9-af53-9a8ed99bd476 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.200513 Aug 31 19:22:18.695711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 362/767] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:18 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:18.704099 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:18.705499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:18.712479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.713040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.713489 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.714218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6fdecccb-b657-4bdd-b85d-bd1a71e6652c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "POST /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389281 Aug 31 19:22:18.714880 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.714880 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.718639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.718960 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 406/768] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:22:18 2022] POST /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:18.722268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:18.722972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] [instance: 89bbe0cb-0063-4409-968c-0d6001b17802] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:18.730198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.730746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.731261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.731968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:18.732416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:18.732891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:18.746477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] HTTP exception thrown: Instance 89bbe0cb-0063-4409-968c-0d6001b17802 could not be found. Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Request method failure captured: Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 HTTP/1.1 Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7Sayo2Vc69wGsFNcH15C9aizZLj-E0UInA5LRpcLmCcBqmjBnmXoV1mYugAkM-PMs38r03uOuBmV361TP_hcHuN7X_V9CKpIVHlCbccgr6PgNc2B-soubpMJFsYsQuSZcO9uueN1ebhaLSV8Bo4Q_kdNSQRo7Q9EMWAQWko3y1zkmY Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: d9f01988234948f18e7182e829cbcf0b Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesNegativeTest-1345754135 Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:22:18.748129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d9f01988234948f18e7182e829cbcf0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d9f01988234948f18e7182e829cbcf0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d9f01988234948f18e7182e829cbcf0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d9f01988234948f18e7182e829cbcf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesNegativeTest-1345754135 Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: d9f01988234948f18e7182e829cbcf0b Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesNegativeTest-1345754135 Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesNegativeTest-1345754135-project Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: c5efa16ebc44403b8382ecc784e1eddf Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesNegativeTest-1345754135-project Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 89bbe0cb-0063-4409-968c-0d6001b17802 could not be found. Aug 31 19:22:18.749552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '89bbe0cb-0063-4409-968c-0d6001b17802'} Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89bbe0cb-0063-4409-968c-0d6001b17802 could not be found. Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:22:18.750602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89bbe0cb-0063-4409-968c-0d6001b17802 could not be found. Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89bbe0cb-0063-4409-968c-0d6001b17802 could not be found. Aug 31 19:22:18.751862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:22:18.753386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] Returning 404 to user: Instance 89bbe0cb-0063-4409-968c-0d6001b17802 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:22:18.756657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-850cf5c7-6eb4-4a7e-ac15-fe2085380e16 tempest-VolumesNegativeTest-1345754135 tempest-VolumesNegativeTest-1345754135-project] 10.222.0.95 "GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802" status: 404 len: 111 microversion: 2.1 time: 0.033075 Aug 31 19:22:18.760319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 407/769] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:18 2022] GET /compute/v2.1/servers/89bbe0cb-0063-4409-968c-0d6001b17802 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:22:18.852752 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:18.862642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:18.864126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:18.865395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8a36269c-d9bb-443c-8400-fe3181f7aff5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.168696 Aug 31 19:22:18.865948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 363/770] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:18 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:19.717179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:19.717799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:19.725048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:19.725610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:19.726125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:19.726968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:19.727490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:19.728001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:19.889065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:19.889781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:19.898437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:19.899099 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:19.899884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:19.901298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:19.902007 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:19.902180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:19.902839 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:19.912342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d76ea528-504f-4c87-b75e-ae3dce9607c5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.198779 Aug 31 19:22:19.920796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 408/771] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:19 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:20.081021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:20.090861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:20.092676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:20.093944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c30db3f8-49ce-4d65-b21d-997ae683789b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.209056 Aug 31 19:22:20.094501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 364/772] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:19 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:22:20.934737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:20.934737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:20.941670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:20.942169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:20.942679 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:20.943388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:20.943843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:20.944268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:21.084020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:21.091727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-015fddb7-aad9-44d1-887a-b49d6fd27c43 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.161947 Aug 31 19:22:21.092379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 409/773] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:20 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:21.117218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:21.117698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:21.124060 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:21.124633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:21.125026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:21.125726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:21.126180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:21.127107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:21.264216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:21.274533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:21.275960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:21.277145 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-600d2dd4-d245-486d-a86c-0230a22d5cd3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.163931 Aug 31 19:22:21.277961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 365/774] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:21 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:22.114178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:22.114922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:22.126812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:22.127177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:22.127771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:22.128484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:22.128982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:22.129413 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:22.264861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:22.274257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f78ec5f8-68e4-452b-b492-9e18bee8eb18 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.165320 Aug 31 19:22:22.274824 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 410/775] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:22 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:22.300331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:22.301027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:22.307227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:22.307827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:22.308294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:22.309169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:22.309630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:22.310055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:22.458560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:22.468297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:22.470011 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:22.472874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c2e47b06-cfc5-4fcf-b8cd-67a6d3d4528d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.176394 Aug 31 19:22:22.488700 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 366/776] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:22 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:23.295978 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:23.296752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:23.304027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:23.304535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:23.305046 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:23.305767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:23.306224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:23.306652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:23.451297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:23.459379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-87c42a3b-c143-43c6-8ac2-fb5213eac25a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.167427 Aug 31 19:22:23.460129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 411/777] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:23 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:23.496136 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:23.496789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:23.498696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=99 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:23.504316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:23.504829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:23.505261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:23.505958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:23.506405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:23.506824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:23.639614 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:23.648862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:23.650305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:23.651444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-97b635d2-2a0a-43c6-9bb0-b4cdfd425cd7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.159416 Aug 31 19:22:23.651995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 367/778] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:23 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:24.481605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:24.482217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:24.489407 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:24.489881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:24.490318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:24.491011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:24.491462 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:24.491893 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:24.627332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:24.635468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8e9f4106-9ed3-498b-8153-d554d883c82a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.158029 Aug 31 19:22:24.636033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 412/779] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:24 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:24.674792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:24.675394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:24.681475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:24.681949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:24.682382 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:24.683065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:24.683523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:24.683947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:24.816170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:24.824627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:24.826054 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:24.827217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1cd2e7af-c68e-4630-b000-350ad186299c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1805 microversion: 2.20 time: 0.156962 Aug 31 19:22:24.827764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 368/780] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:24 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:25.252187 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-101fd613-e0e5-4ad8-b39e-0ccd6b23e9e7 req-0b4d9b23-1b48-43b2-a65a-db35c56d38d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "name": "network-vif-plugged", "status": "completed", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:25.261986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-101fd613-e0e5-4ad8-b39e-0ccd6b23e9e7 req-0b4d9b23-1b48-43b2-a65a-db35c56d38d1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:25.262512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-101fd613-e0e5-4ad8-b39e-0ccd6b23e9e7 req-0b4d9b23-1b48-43b2-a65a-db35c56d38d1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:25.262942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-101fd613-e0e5-4ad8-b39e-0ccd6b23e9e7 req-0b4d9b23-1b48-43b2-a65a-db35c56d38d1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:25.279476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-101fd613-e0e5-4ad8-b39e-0ccd6b23e9e7 req-0b4d9b23-1b48-43b2-a65a-db35c56d38d1 service nova] Creating event network-vif-plugged:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:22:25.285547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-101fd613-e0e5-4ad8-b39e-0ccd6b23e9e7 req-0b4d9b23-1b48-43b2-a65a-db35c56d38d1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036650 Aug 31 19:22:25.286138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 413/781] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:22:25.655167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:25.655844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:25.662329 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:25.662808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:25.663329 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:25.664014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:25.664457 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:25.664899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:25.804435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:25.811948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-25ecf41b-1b15-44f7-85f3-147b607b8ef7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.160568 Aug 31 19:22:25.812497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 369/782] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:25 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:25.852173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:25.852883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:25.859007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:25.859480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:25.859910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:25.860613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:25.861067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:25.861479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:25.997259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:26.006739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:26.008171 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:26.010229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-aeb3ec17-e700-4f46-bd08-fc21cac99b2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1792 microversion: 2.20 time: 0.162463 Aug 31 19:22:26.011197 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 414/783] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:22:25 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1792 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:22:26.835027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:26.835632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:26.841497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:26.841966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:26.842387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:26.843057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:26.843497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:26.843914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:26.972250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:26.979863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-898d2408-7d94-4d13-bc1f-0a6ac831ff65 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.150573 Aug 31 19:22:26.980416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 370/784] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:26 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:28.002575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:28.003116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:28.009556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:28.010034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:28.010472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:28.011155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:28.011638 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:28.012155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:28.148262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:28.156044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-97a06e97-9bd5-4bcf-9668-ead350d6cfe8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.157981 Aug 31 19:22:28.156623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 415/785] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:27 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:28.403347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:28.403932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:28.410654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:28.411132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:28.411560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:28.412266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:28.412718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:28.413136 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:28.562837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'services' on Instance uuid 4e955cd6-de98-48e5-90af-020d4952bc40 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:28.694884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5a81c467-1e58-411a-a3fa-30766d89afa6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-volume_attachments/a47f1b32-5fe3-45a7-8add-004caa8b111f" status: 202 len: 0 microversion: 2.1 time: 0.295670 Aug 31 19:22:28.695467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 371/786] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:22:28 2022] DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-volume_attachments/a47f1b32-5fe3-45a7-8add-004caa8b111f => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:22:29.179535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:29.180122 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:29.186546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:29.187047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:29.187479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:29.188190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:29.188687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:29.189890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:29.341450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:29.350658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-af37ce8c-a739-48f6-8ca4-0bc0a65ec25e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.176395 Aug 31 19:22:29.351248 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 416/787] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:29 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:30.375766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:30.378453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:30.384648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:30.385129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:30.385562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:30.386245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:30.386693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:30.387112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:30.525301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:30.533006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5f366704-0ce5-40ec-bc35-0fb47c83332c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.161381 Aug 31 19:22:30.533561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 372/788] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:30 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:31.555140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:31.555753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:31.562408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:31.562897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:31.563335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:31.564739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:31.565250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:31.565786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:31.859743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:31.868136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b914acc6-3476-402c-a1eb-9cf4b27b7846 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.316891 Aug 31 19:22:31.868719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 417/789] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:31 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:32.889210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:32.889876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:32.895952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:32.896420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:32.896891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:32.897578 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:32.898020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:32.898432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:33.089210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:33.097945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7e1efa06-ef9f-4313-900a-ec0ace1db01b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1357 microversion: 2.1 time: 0.212685 Aug 31 19:22:33.098504 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 373/790] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:32 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:34.119654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:34.120288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:34.127981 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.128467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.128932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.129699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.130155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.130579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.262093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:34.270801 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1375f139-7188-4fca-9e72-a9187c50c9ca tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1547 microversion: 2.1 time: 0.155099 Aug 31 19:22:34.271359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 418/791] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:34 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:34.291320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:34.292096 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:34.297953 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.298994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.299425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.300108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.300556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.300996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.429679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:34.441306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ff8cd351-747e-4a7e-85a5-f3879f80fe04 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1547 microversion: 2.1 time: 0.153732 Aug 31 19:22:34.441874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 374/792] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:34 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:34.461447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:34.466564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:34.467321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Searching by: {'deleted': False, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804'} {{(pid=120706) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 19:22:34.474608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.475076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.475511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.476217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.476686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.477133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.567164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.multi_cell_list [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120706) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 19:22:34.592098 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:34.662743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1f8376a2-30e5-4914-8b55-6f7e8d83ca0e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205106 Aug 31 19:22:34.663321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 419/793] 10.222.0.95 () {58 vars in 1125 bytes} [Wed Aug 31 19:22:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:34.674485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:34.675088 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:34.681103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.681584 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.682036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.682722 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:34.683174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:34.683601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:34.816773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:34.824472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-94f70fb7-f40d-4dca-9359-f2fa561bf8f0 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1547 microversion: 2.1 time: 0.153843 Aug 31 19:22:34.824994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 375/794] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:34 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:38.570957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ffd52d2-3124-4613-8ae5-c58d30f34065"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:38.573312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:38.575851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=69 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:38.581771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:38.582253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:38.582686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:38.583530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:38.583980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:38.584399 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:39.462411 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-382c9ce4-7870-4967-88f3-450e583ee172 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:39.468637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-382c9ce4-7870-4967-88f3-450e583ee172 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:39.469109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-382c9ce4-7870-4967-88f3-450e583ee172 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:39.469546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-382c9ce4-7870-4967-88f3-450e583ee172 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:39.492510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-382c9ce4-7870-4967-88f3-450e583ee172 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Going to try to stop instance {{(pid=120707) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 19:22:39.536536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-382c9ce4-7870-4967-88f3-450e583ee172 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action" status: 202 len: 0 microversion: 2.1 time: 0.077717 Aug 31 19:22:39.537162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 376/795] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:22:39 2022] POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:22:39.548209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:39.549132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:39.555204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:39.555683 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:39.556112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:39.556823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:39.557275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:39.557694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:39.690292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:39.693793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:39.699000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f60a939a-1629-4eed-aa4a-5f385c012773 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.154994 Aug 31 19:22:39.699555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 377/796] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:39 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:40.722108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:40.722831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:40.729932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:40.730407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:40.730838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:40.731528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:40.731984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:40.732404 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:40.871202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:40.879040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2d023f8-4bf5-4f5e-b9ce-acc1089998fe tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.161842 Aug 31 19:22:40.879597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 378/797] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:40 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:41.899946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:41.900673 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:41.906678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:41.907141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:41.907570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:41.908246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:41.908792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:41.909214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:42.052993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:42.061241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0e043f5b-8373-43f7-8ae4-ccda51ff67ea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.164999 Aug 31 19:22:42.061829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 379/798] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:41 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:42.119651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5bfbeada-b359-4d09-8d46-32d63a6ea651 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.552813 Aug 31 19:22:42.120288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 420/799] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:22:38 2022] POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments => generated 194 bytes in 3555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:43.086479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:43.087081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:43.093674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.094342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.094742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.095456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.096608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.097052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.239705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:43.248170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d240b123-8e0c-4c2c-bb81-ed6272f56f6f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.167773 Aug 31 19:22:43.248961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 380/800] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:43 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:43.343861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:43.344427 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:43.351099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.351595 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.352030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.352789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.353253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.353786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.385240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7555e9e7-4bc2-4c6e-8ba8-ce96941dd999 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/ips" status: 200 len: 148 microversion: 2.1 time: 0.046607 Aug 31 19:22:43.386155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 421/801] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:22:43 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/ips => generated 148 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:43.398562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5aebc5a-fd02-4940-a5c5-38c80c37287e"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:43.401110 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:43.407257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.407736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.408200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.409597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.410319 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.410751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.496408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Invalid volume: volume c5aebc5a-fd02-4940-a5c5-38c80c37287e is already attached to instances: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: POST /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/os-volume_attachments HTTP/1.1 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 74 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:22:43.498216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {"volumeAttachment": {"volumeId": "c5aebc5a-fd02-4940-a5c5-38c80c37287e"}} Aug 31 19:22:43.499893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Invalid volume: volume c5aebc5a-fd02-4940-a5c5-38c80c37287e is already attached to instances: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'server_id': '0ed0083d-53d6-4dde-adff-552a74a61c5f', 'body': {'volumeAttachment': {'volumeId': 'c5aebc5a-fd02-4940-a5c5-38c80c37287e'}}} Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c5aebc5a-fd02-4940-a5c5-38c80c37287e is already attached to instances: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:43.500844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c5aebc5a-fd02-4940-a5c5-38c80c37287e is already attached to instances: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:43.502877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c5aebc5a-fd02-4940-a5c5-38c80c37287e is already attached to instances: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 400 to user: Invalid volume: volume c5aebc5a-fd02-4940-a5c5-38c80c37287e is already attached to instances: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0376335b-39cb-461d-b7f3-6ea950d32f80 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105354 Aug 31 19:22:43.504561 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 381/802] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:22:43 2022] POST /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:22:43.509539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:43.510058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:43.516698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.517187 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.518414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.519580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.520042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.520472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.700064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:22:43.777845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8a0dbe09-8d68-45f6-a752-c341d7996f45 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 204 len: 0 microversion: 2.1 time: 0.271652 Aug 31 19:22:43.781616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 422/803] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:22:43 2022] DELETE /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:22:43.787547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:43.788406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:43.797410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.797947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.798702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.800001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:43.800508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:43.801024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:43.954279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:43.962459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7d34e8df-676e-44da-8756-c4a94da9f1a1 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1680 microversion: 2.1 time: 0.179311 Aug 31 19:22:43.963027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 382/804] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:43 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:44.271737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:44.272697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:44.280103 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:44.281511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:44.282337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:44.283024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:44.283805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:44.284281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:44.420663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:44.429784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c1c3fe6f-9bad-429e-95e5-60c9304c330a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.163335 Aug 31 19:22:44.430362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 423/805] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:44 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:44.984788 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:44.985401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:44.992118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:44.992629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:44.993071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:44.993771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:44.994227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:44.994652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:45.133869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:45.142262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1ae145a5-8d34-4dbf-8e2a-b9160e53c0a3 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1680 microversion: 2.1 time: 0.161326 Aug 31 19:22:45.143693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 383/806] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:44 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:45.452052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:45.452753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:45.455765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:45.461430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:45.462006 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:45.462352 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:45.463049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:45.463499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:45.464254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:45.598076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:45.605883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-20ad5d48-ed54-4c0e-b436-db1c86ecf0ab tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.157669 Aug 31 19:22:45.606439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 424/807] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:45 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:45.827700 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:45.828186 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:45.835773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:45.836247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:45.836713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:45.837427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:45.837875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:45.838291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:45.921815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'services' on Instance uuid 17c7d734-295c-4bc0-8233-004d4d31bb36 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:45.998719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-705352b0-3dd9-41ab-b902-9e3836c4be0e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "DELETE /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36/os-volume_attachments/2a12b190-5f40-4436-8c91-71279ceeba0e" status: 202 len: 0 microversion: 2.1 time: 0.174828 Aug 31 19:22:45.999360 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 384/808] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:22:45 2022] DELETE /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36/os-volume_attachments/2a12b190-5f40-4436-8c91-71279ceeba0e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:22:46.165319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:46.165931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:46.171917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:46.172393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:46.172869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:46.173558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:46.174756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:46.175279 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:46.316856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:46.324941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a14ebe24-4dc3-4ab4-8285-9b00beb6ef7d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1680 microversion: 2.1 time: 0.163541 Aug 31 19:22:46.325532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 425/809] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:46 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:46.627793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:46.628498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:46.635361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:46.635943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:46.636502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:46.637243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:46.638078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:46.638202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:46.790061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:46.800480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-66184721-3a99-4933-b7db-85785bf215b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.176675 Aug 31 19:22:46.801397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 385/810] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:46 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:47.346382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:47.347830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:47.354586 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.355073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.355510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.356225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.356720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.357139 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.425421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:47.433310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8fe67e5a-285a-4434-836a-3b1bf668e44b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1612 microversion: 2.1 time: 0.091033 Aug 31 19:22:47.433878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 426/811] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:47 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:47.526383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-a3bf4508-c374-4da7-af58-92e750c0b2d7 req-e5ecbf78-47de-4a06-ac84-2871ff231696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed0083d-53d6-4dde-adff-552a74a61c5f", "name": "network-vif-deleted", "tag": "1cc9f64a-9a42-4ece-874b-739926a8e215"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:47.537118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a3bf4508-c374-4da7-af58-92e750c0b2d7 req-e5ecbf78-47de-4a06-ac84-2871ff231696 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.537584 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a3bf4508-c374-4da7-af58-92e750c0b2d7 req-e5ecbf78-47de-4a06-ac84-2871ff231696 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.538198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a3bf4508-c374-4da7-af58-92e750c0b2d7 req-e5ecbf78-47de-4a06-ac84-2871ff231696 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.552352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-a3bf4508-c374-4da7-af58-92e750c0b2d7 req-e5ecbf78-47de-4a06-ac84-2871ff231696 service nova] Creating event network-vif-deleted:1cc9f64a-9a42-4ece-874b-739926a8e215 for instance 0ed0083d-53d6-4dde-adff-552a74a61c5f on hv-cinder-85221 Aug 31 19:22:47.557601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-a3bf4508-c374-4da7-af58-92e750c0b2d7 req-e5ecbf78-47de-4a06-ac84-2871ff231696 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034923 Aug 31 19:22:47.558223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 386/812] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:47.823366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:47.824293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:47.831173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.831675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.832622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.833417 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:47.833910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:47.834470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:47.998743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:48.007500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ffceb79d-9ffb-4830-b598-499c6a889518 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.187812 Aug 31 19:22:48.017443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 427/813] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:47 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:48.458313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:48.459030 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:48.466811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:48.467264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:48.467895 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:48.469461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:48.470156 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:48.472013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:48.519434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:48.520172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:48.520626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:48.521074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'fault' on Instance uuid 0ed0083d-53d6-4dde-adff-552a74a61c5f {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:48.572087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:48.589108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-82707b14-5607-4b0b-ba02-db48d95066ab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 200 len: 1331 microversion: 2.1 time: 0.136740 Aug 31 19:22:48.596835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 387/814] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:48 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:49.136383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:49.137024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:49.143770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:49.144382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:49.144862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:49.145577 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:49.146056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:49.146566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:49.298138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:49.307071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-14e0d4ed-b978-423f-bea1-7de62745c4af tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.282088 Aug 31 19:22:49.307666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 428/815] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:49 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:49.729706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:49.730348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:49.736937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:49.737430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:49.737866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:49.738570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:49.739024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:49.739452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:49.754494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f HTTP/1.1 Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:22:49.756129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:22:49.758910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '0ed0083d-53d6-4dde-adff-552a74a61c5f'} Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:22:49.760038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:22:49.761422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:22:49.762613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:22:49.762613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-abebe24d-b1d0-4a95-b718-8858a263c9bf tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 404 len: 111 microversion: 2.1 time: 0.150023 Aug 31 19:22:49.762613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 388/816] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:49 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:22:49.767260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-19a66d9f-b501-4985-810b-90282ec1d991 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '.version_select at 0x7f97632e2430>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:49.789765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-19a66d9f-b501-4985-810b-90282ec1d991 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-912282704" status: 202 len: 0 microversion: 2.1 time: 0.026234 Aug 31 19:22:49.790339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 429/817] 10.222.0.95 () {58 vars in 1218 bytes} [Wed Aug 31 19:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-912282704 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:22:50.328313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:50.329143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:50.337058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.338642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.339072 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.339922 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.340375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.340867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.536252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:50.543925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1f44d85e-7f80-492a-8eab-f106143508b7 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.219397 Aug 31 19:22:50.544483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 389/818] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:50 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:50.571063 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:50.571627 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:50.578113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.578596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.579028 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.579729 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.580948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.581380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.713757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'services' on Instance uuid 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:50.849198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-503abc98-3b87-4058-b0b0-d35686f1ab02 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments/c5aebc5a-fd02-4940-a5c5-38c80c37287e" status: 202 len: 0 microversion: 2.1 time: 0.282303 Aug 31 19:22:50.849800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 430/819] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:22:50 2022] DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments/c5aebc5a-fd02-4940-a5c5-38c80c37287e => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:22:50.859615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:50.862347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:50.868649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.869130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.869559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.870243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.870691 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.871104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.874778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:50.875476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:50.887456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.890142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.891284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.894291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:50.896398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:50.899037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:50.911495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b4ba4f30-d738-46b6-af0d-786893706e0d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057078 Aug 31 19:22:50.911972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 390/820] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:22:50 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:51.046955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:51.055555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-67d3e68f-12c4-406a-acf7-424e73d9e05f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1593 microversion: 2.1 time: 0.185054 Aug 31 19:22:51.056157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 431/821] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:50 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1593 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:51.387728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:51.388310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:51.395135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.395630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.396283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.397016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.397474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.397897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.424916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:22:51.510074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-55ddc0ae-439f-4249-bdd8-7ee0be783276 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "DELETE /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 204 len: 0 microversion: 2.1 time: 0.125993 Aug 31 19:22:51.510693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 391/822] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:22:51 2022] DELETE /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:22:51.518869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:51.519472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:51.525251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.525717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.526143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.526824 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.527287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.527687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.565927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:51.566614 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:51.573125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.573743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.574334 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.575044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.575498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.576094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.803709 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:51.815965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c061d305-9809-45fd-a832-6a301e658445 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1512 microversion: 2.1 time: 0.300495 Aug 31 19:22:51.816884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 432/823] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:51 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:51.854952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:51.863793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b0c1f288-b0e5-4508-ada0-7cee70ad835b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.302216 Aug 31 19:22:51.864732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 392/824] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:51 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:51.924647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:51.927064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:51.933756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.934356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.934873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.935677 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:51.936213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:51.936740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:51.955871 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:51.971624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1c29c790-3e6c-4d9e-82dd-6d1a08573c7f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051991 Aug 31 19:22:51.972215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 433/825] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:22:51 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:52.032588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:52.033841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:52.040071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.040687 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.041195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.041896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.042523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.042944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.047059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:52.070254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lazy-loading 'flavor' on Instance uuid a83d3294-0902-4f21-a7b9-45b2b5229c52 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:52.169684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-319fe055-ece8-4bb1-bdad-40fc51c2be28 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "POST /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52/action" status: 202 len: 0 microversion: 2.1 time: 0.140871 Aug 31 19:22:52.170423 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 393/826] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:22:52 2022] POST /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:22:52.179603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:52.180321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:52.186348 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.186825 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.187257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.187953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.188404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.188848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.649786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:52.657577 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-34f8bcbe-ecb1-4972-b8b6-5222fbe7f816 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.482018 Aug 31 19:22:52.658831 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 434/827] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:52 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:52.838164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:52.838864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:52.845237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.845852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.846415 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.847071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.847529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.847952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.889169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:52.889782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:52.896891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.897391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.897813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:52.898513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:52.898972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:52.899388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.144384 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:53.153584 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eeaac704-d02f-41ef-a853-ae39ecef3934 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1512 microversion: 2.1 time: 0.319618 Aug 31 19:22:53.154456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 394/828] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:52 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:53.160230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:53.163458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:53.169809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.170286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.170714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.171407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.171844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.172260 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.205746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:53.206946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ad90d858-dfaf-4abf-b480-38086beb2fd4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051292 Aug 31 19:22:53.207744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 395/829] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:22:53 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:53.215282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-080c7abd-e81e-45fd-8871-2c1e74817ed0 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.329959 Aug 31 19:22:53.215866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 435/830] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:52 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:53.496792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-6b3df966-d178-4687-83f9-450747f9d16f req-6d50d633-42b0-4031-b736-f5e95f804cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:53.506363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-6b3df966-d178-4687-83f9-450747f9d16f req-6d50d633-42b0-4031-b736-f5e95f804cb5 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.506835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-6b3df966-d178-4687-83f9-450747f9d16f req-6d50d633-42b0-4031-b736-f5e95f804cb5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.507257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-6b3df966-d178-4687-83f9-450747f9d16f req-6d50d633-42b0-4031-b736-f5e95f804cb5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.520443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-6b3df966-d178-4687-83f9-450747f9d16f req-6d50d633-42b0-4031-b736-f5e95f804cb5 service nova] Creating event network-changed:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:22:53.526020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-6b3df966-d178-4687-83f9-450747f9d16f req-6d50d633-42b0-4031-b736-f5e95f804cb5 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032885 Aug 31 19:22:53.526956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 396/831] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:53.680559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:53.683218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:53.690479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.691163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.691805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.692848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:53.693304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:53.693896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:53.891329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:53.901834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3517303b-63cf-4f4f-b7a8-052c5731ab3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.225696 Aug 31 19:22:53.902773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 436/832] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:53 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:54.178096 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:54.178984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:54.181112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:54.188542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.189678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.190234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.191657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.192392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.192938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.220474 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:54.223143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:54.234556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.236631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.240492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.241957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.242626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.243263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.290149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ca7c11e1-e55f-4f52-8a1a-e0b721de8e36 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074337 Aug 31 19:22:54.291633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 437/833] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:22:54 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:54.297261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:54.297912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:54.307332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.307332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.307332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.307774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.308043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.308427 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.478749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:54.491758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dc3e6ca9-8a58-4bb3-a6e3-86237d7b6a19 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1512 microversion: 2.1 time: 0.318525 Aug 31 19:22:54.492625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 397/834] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:54 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:54.537528 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:54.553004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-12cda110-ed3a-43fd-a309-9040178cacf3 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.259920 Aug 31 19:22:54.553884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 438/835] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:54 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:54.666827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1614914604"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:54.667358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:54.674726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.675316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.675749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.676450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.676937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.677350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.815562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.network.security_group_api [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Adding security group c174b445-04d2-4b4a-b920-7a252422fe97 to port f96dd63c-f856-4c10-87ce-0a63e89f3d3b Aug 31 19:22:54.924388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:54.925105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:54.936816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.937312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.937749 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:54.938461 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:54.938914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:54.939391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.184600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.193197 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1b14dd3f-b369-4e62-b4b2-fac4371e59ae tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.273584 Aug 31 19:22:55.193783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 439/836] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:54 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:55.290547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7cb3aa90-57e9-470b-8a7c-734f09c93f64 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/action" status: 202 len: 0 microversion: 2.1 time: 0.627717 Aug 31 19:22:55.291523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 398/837] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:22:54 2022] POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:22:55.302974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.304273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:55.309057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.311766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.312516 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:55.312810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.314803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.315766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.316674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.317327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.322126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.324863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.325359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.326289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.326816 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.327250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.429387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d0735371-4005-4913-a8ac-a91792d1ff79 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126205 Aug 31 19:22:55.430344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 399/838] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:55.514145 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.515868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.519442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:55.526301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ed33a43b-35fd-42ba-a97c-aa58267b30b3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1640 microversion: 2.1 time: 0.229758 Aug 31 19:22:55.528036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 440/839] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1640 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:55.547599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-c59fa4ff-4537-44a0-838b-36114bccf6d8 req-a23c6351-d037-4338-9b2d-0015e8dc08c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:55.550133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.550631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.553203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.554243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.554950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.555491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.579338 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c59fa4ff-4537-44a0-838b-36114bccf6d8 req-a23c6351-d037-4338-9b2d-0015e8dc08c1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.584257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c59fa4ff-4537-44a0-838b-36114bccf6d8 req-a23c6351-d037-4338-9b2d-0015e8dc08c1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.585557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-c59fa4ff-4537-44a0-838b-36114bccf6d8 req-a23c6351-d037-4338-9b2d-0015e8dc08c1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.601755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-c59fa4ff-4537-44a0-838b-36114bccf6d8 req-a23c6351-d037-4338-9b2d-0015e8dc08c1 service nova] Creating event network-changed:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:22:55.610389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-c59fa4ff-4537-44a0-838b-36114bccf6d8 req-a23c6351-d037-4338-9b2d-0015e8dc08c1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068389 Aug 31 19:22:55.612152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 441/840] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:55.619022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.620137 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:55.633901 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.634917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.636438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.637911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.638693 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.639541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.811718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.821677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c99c549f-9aae-486d-8c2f-f6ca3d6ea82c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1512 microversion: 2.1 time: 0.309805 Aug 31 19:22:55.836437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 400/841] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:55.881365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:55.896014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-98452889-d537-4d2d-a11f-f53f9b8af816 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.282147 Aug 31 19:22:55.897217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 442/842] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:56.160429 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-2c72ce7f-0599-404f-97fd-1f80ced21a9d req-70c28f0b-11f0-446b-8f44-62f6fc1f7ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c7d734-295c-4bc0-8233-004d4d31bb36", "name": "network-vif-deleted", "tag": "bc5bf427-9fc5-46fe-89e3-39dbe7188e00"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:22:56.171142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2c72ce7f-0599-404f-97fd-1f80ced21a9d req-70c28f0b-11f0-446b-8f44-62f6fc1f7ad3 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.171602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2c72ce7f-0599-404f-97fd-1f80ced21a9d req-70c28f0b-11f0-446b-8f44-62f6fc1f7ad3 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.172026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2c72ce7f-0599-404f-97fd-1f80ced21a9d req-70c28f0b-11f0-446b-8f44-62f6fc1f7ad3 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.184676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-2c72ce7f-0599-404f-97fd-1f80ced21a9d req-70c28f0b-11f0-446b-8f44-62f6fc1f7ad3 service nova] Creating event network-vif-deleted:bc5bf427-9fc5-46fe-89e3-39dbe7188e00 for instance 17c7d734-295c-4bc0-8233-004d4d31bb36 on hv-cinder-85221 Aug 31 19:22:56.190045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-2c72ce7f-0599-404f-97fd-1f80ced21a9d req-70c28f0b-11f0-446b-8f44-62f6fc1f7ad3 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Aug 31 19:22:56.190639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 401/843] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:22:56.215634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.216339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.224025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.224507 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.225001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.225701 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.226327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.226922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.361423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:56.370104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-355195b2-8637-4d03-b1c8-541e3592fafa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.158346 Aug 31 19:22:56.370672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 443/844] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:56.443534 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.446021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.452221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.452767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.453200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.454085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.455131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.455570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.487389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fbe2e0dc-2e12-4c3e-94d4-3331ee70060c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049256 Aug 31 19:22:56.487957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 402/845] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:22:56.551568 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.552719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.561938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.562426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.562863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.563582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.564038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.564469 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.594522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:22:56.679224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-43d03319-04ed-4068-b669-70594e600886 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 204 len: 0 microversion: 2.1 time: 0.131681 Aug 31 19:22:56.679868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 444/846] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:22:56 2022] DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:22:56.688069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.689692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.698773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.699589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.700297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.701680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.702487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.703220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.843782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.844479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.851204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.851698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.852135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.852867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.853223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:56.853382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.853732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.862412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-15ad8e78-353a-46d7-a857-7fd901dd7652 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1680 microversion: 2.1 time: 0.176771 Aug 31 19:22:56.862412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 403/847] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:56.888390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.888817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.889247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.889692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'fault' on Instance uuid 17c7d734-295c-4bc0-8233-004d4d31bb36 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:56.917935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.918825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:56.925634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.926150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.926609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.927381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.927837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.928291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.931929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:56.940913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-23345978-e0e0-4c95-8df0-25f87a8fc943 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1308 microversion: 2.1 time: 0.100725 Aug 31 19:22:56.941508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 445/848] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:57.062636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:57.070834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3352eb15-eaef-4f5c-b019-6f667cc9d8b9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.156794 Aug 31 19:22:57.071399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 404/849] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:57.391304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:57.392068 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:57.398637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.399120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.399560 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.400259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.400745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.401178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.547138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:57.555812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-590190d7-e77e-4d76-aef3-c416b01355c9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.168654 Aug 31 19:22:57.556381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 446/850] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:57 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:57.882344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:57.883058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:57.889171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.889648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.890082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.890864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.891316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.891736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.968386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:57.969380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:57.976925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.977416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.977915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:57.978665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:57.979108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:57.979731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.014722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.015207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.015644 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.016092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'fault' on Instance uuid 17c7d734-295c-4bc0-8233-004d4d31bb36 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:58.027295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:58.036277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0016e451-8b7b-46b9-abda-8515d7acbd41 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1680 microversion: 2.1 time: 0.157270 Aug 31 19:22:58.037211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 405/851] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:57 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:58.057967 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:58.065869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-548bfd26-7b20-423a-a432-42a687ff56da tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1308 microversion: 2.1 time: 0.104263 Aug 31 19:22:58.066434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 447/852] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:57 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:58.092829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:58.093434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:58.100882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.101366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.101800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.102498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.102949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.103371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.239767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:58.247550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ff2f9f36-13ae-44f6-aa13-b639a619bc4e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.158544 Aug 31 19:22:58.248106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 406/853] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:58 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:58.581105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:58.581955 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:58.590789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.591377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.591857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.592599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:58.593153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:58.593579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:58.614093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:58.734262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:58.743626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b3cb05b7-99e4-4a3f-8411-545022d0985d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.169250 Aug 31 19:22:58.744608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 448/854] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:58 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:59.057935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:59.058541 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:59.065166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.065653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.066071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.066759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.067203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.067627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.087492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:59.088218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:59.094377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.095261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.096162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.097012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.097539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.098073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.132114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.132753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.133196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.133651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'fault' on Instance uuid 17c7d734-295c-4bc0-8233-004d4d31bb36 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:22:59.189997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.198304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8883c4ff-532f-4d73-a02f-24dcc5120ea3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 200 len: 1308 microversion: 2.1 time: 0.114820 Aug 31 19:22:59.198912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 449/855] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:59 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:22:59.227226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.234916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-50d95c99-317e-40af-9305-44a239a454bc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1680 microversion: 2.1 time: 0.181144 Aug 31 19:22:59.235481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 407/856] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:59 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:59.269913 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:59.270512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:59.276597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.277092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.277527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.278219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.278669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.279093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.432384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.440395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7c8de7d8-2c80-41ae-a9a4-78106f0db8b5 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1677 microversion: 2.1 time: 0.174989 Aug 31 19:22:59.447412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 450/857] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:59 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:59.768636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:59.769233 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:22:59.775859 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.776343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.776817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.777523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:59.777974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:59.778400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:59.918254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:22:59.928040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-91110e88-e39b-42ae-b17a-ddf42b5e377f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.163302 Aug 31 19:22:59.928661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 408/858] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:22:59 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:00.221141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:00.222008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 17c7d734-295c-4bc0-8233-004d4d31bb36] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:00.228597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.229069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.229513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.230282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.230746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.231225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.246590 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] HTTP exception thrown: Instance 17c7d734-295c-4bc0-8233-004d4d31bb36 could not be found. Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Request method failure captured: Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 HTTP/1.1 Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7Sp8vKFePOBmoPq7azCiLkLYHQ8eDFh8eWnMZQeu1SUZjNJAJzPFmuyfFxwTC_-rTkFtIZPyOEr1wIE69_RPr7pf1kLItJ12eAHhcN-OlTAO3mdeZtu0C5d8Sy2p9Axhv-ldU4pkGTVdtua2qNIFwhQ2moBI_ttMEyQc7Umi7_Oxtg Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 3b530b6cef6943ee93e561b05d1f846d Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1988652071 Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:23:00.249142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotTestJSON-1988652071 Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 3b530b6cef6943ee93e561b05d1f846d Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1988652071 Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotTestJSON-1988652071-project Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 1e04230bb5b34b27aad5c2a46230a5cc Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotTestJSON-1988652071-project Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 17c7d734-295c-4bc0-8233-004d4d31bb36 could not be found. Aug 31 19:23:00.250724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '17c7d734-295c-4bc0-8233-004d4d31bb36'} Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c7d734-295c-4bc0-8233-004d4d31bb36 could not be found. Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:00.251929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c7d734-295c-4bc0-8233-004d4d31bb36 could not be found. Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c7d734-295c-4bc0-8233-004d4d31bb36 could not be found. Aug 31 19:23:00.254996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:00.256909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Returning 404 to user: Instance 17c7d734-295c-4bc0-8233-004d4d31bb36 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:00.256909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-84582dea-b47d-45df-819d-ff3fd0823390 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36" status: 404 len: 111 microversion: 2.1 time: 0.034336 Aug 31 19:23:00.256909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 451/859] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:00 2022] GET /compute/v2.1/servers/17c7d734-295c-4bc0-8233-004d4d31bb36 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:00.261633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:00.262789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:00.271812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.272607 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.273220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.275725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.276214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.276676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.298437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:00.323680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-0469b220-b746-4181-a218-f6daa8c0afdb req-49fcd119-cbb2-4c6e-af2a-fbd231c1d0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9952e4e3-5b71-4512-8bc4-cd0339fc24c7", "name": "network-vif-deleted", "tag": "9b68f3b2-a4ed-4d2d-8371-adf91acb6cac"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:00.343236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-0469b220-b746-4181-a218-f6daa8c0afdb req-49fcd119-cbb2-4c6e-af2a-fbd231c1d0ac service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.344014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-0469b220-b746-4181-a218-f6daa8c0afdb req-49fcd119-cbb2-4c6e-af2a-fbd231c1d0ac service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.344438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-0469b220-b746-4181-a218-f6daa8c0afdb req-49fcd119-cbb2-4c6e-af2a-fbd231c1d0ac service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.365456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-0469b220-b746-4181-a218-f6daa8c0afdb req-49fcd119-cbb2-4c6e-af2a-fbd231c1d0ac service nova] Creating event network-vif-deleted:9b68f3b2-a4ed-4d2d-8371-adf91acb6cac for instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 on hv-cinder-85221 Aug 31 19:23:00.365875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:00.372824 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-0469b220-b746-4181-a218-f6daa8c0afdb req-49fcd119-cbb2-4c6e-af2a-fbd231c1d0ac service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052481 Aug 31 19:23:00.375494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0b9d8bc-53a7-45a5-a8d4-4e6afb800ab0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1614 microversion: 2.1 time: 0.118509 Aug 31 19:23:00.391422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 452/860] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:23:00.393007 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 409/861] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:00 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1614 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:00.464821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:00.465896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:00.473547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.474331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.474961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.475862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.476515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.477311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.724217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:00.733350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-551f5b48-b81c-4f29-a44d-ef2c1ce90166 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1654 microversion: 2.1 time: 0.273121 Aug 31 19:23:00.734030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 453/862] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:00 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1654 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:00.754877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3a1fc18a-75b2-4fd3-a55e-739b27078b86 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:00.762572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18a-75b2-4fd3-a55e-739b27078b86 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.763059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18a-75b2-4fd3-a55e-739b27078b86 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.763500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3a1fc18a-75b2-4fd3-a55e-739b27078b86 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.791841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3a1fc18a-75b2-4fd3-a55e-739b27078b86 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Going to try to start instance {{(pid=120707) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 19:23:00.842997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3a1fc18a-75b2-4fd3-a55e-739b27078b86 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action" status: 202 len: 0 microversion: 2.1 time: 0.092324 Aug 31 19:23:00.845382 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 410/863] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:23:00 2022] POST /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:23:00.855497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:00.855726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:00.862573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.863077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.863501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.864211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.864691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.865116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.950947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:00.951748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:00.959648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.960024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.960458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:00.961192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:00.961632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:00.962248 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:01.046334 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:01.055636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-62f74834-01b1-4a2f-8bf3-ccd819f85447 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1663 microversion: 2.1 time: 0.204977 Aug 31 19:23:01.056543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 454/864] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:00 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1663 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:01.121078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:01.129890 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fbea8f85-43d3-470a-9629-79434abba5b9 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.183483 Aug 31 19:23:01.130586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 411/865] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:00 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:01.399560 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:01.400470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:01.407232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:01.408438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:01.409131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:01.409940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:01.410415 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:01.410848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:01.457278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:01.457851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:01.458533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:01.459038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'fault' on Instance uuid 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:01.508053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:01.515834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d3c2ccc6-0c6e-4f4d-9ff4-18d243c62628 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1332 microversion: 2.1 time: 0.120262 Aug 31 19:23:01.516398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 455/866] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:01 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:02.076992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:02.077630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:02.084427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.084941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.085378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.086071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.086527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.086958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.154153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:02.154790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:02.162332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.162817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.163258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.163957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.164412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.164862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.247063 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:02.255498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8e50e31e-8057-488f-bdfb-6142f3a9059a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1663 microversion: 2.1 time: 0.182327 Aug 31 19:23:02.256068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 412/867] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:02 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:02.313549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:02.321965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-60470647-a453-45bb-a89e-e807ceacd268 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.174174 Aug 31 19:23:02.322533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 456/868] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:02 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:02.539621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:02.540209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:02.546151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.546621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.547048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.547718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.548163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.548600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.578906 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:02.580163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:02.580780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:02.581231 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'fault' on Instance uuid 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:02.624680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:02.634328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-59576cf0-88a7-4331-b1bc-ecd978dc07f8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1332 microversion: 2.1 time: 0.098403 Aug 31 19:23:02.634907 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 413/869] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:02 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:03.277012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:03.277592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:03.284105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.284857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.285305 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.285990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.286437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.286857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.343193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:03.343926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:03.350180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.350660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.351095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.351789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.352241 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.352702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.458545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:03.467048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ad39abba-9772-49d1-b197-91e26ac81c3d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1663 microversion: 2.1 time: 0.193437 Aug 31 19:23:03.467779 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 457/870] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:03 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1663 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:03.505682 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:03.513317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d215097b-3597-492f-90d1-99b225e1b017 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.174070 Aug 31 19:23:03.513872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 414/871] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:03 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:03.656854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:03.657458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:03.664329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.664863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.665326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.666407 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.666908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.667341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.695432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:03.701506 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:03.701927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:03.702370 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:03.702817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'fault' on Instance uuid 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:03.751820 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:03.761612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9a3afc64-94de-467f-b7d4-7bb7c6bc02c6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 200 len: 1332 microversion: 2.1 time: 0.108604 Aug 31 19:23:03.762184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 458/872] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:03 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:04.489590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:04.490189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:04.496331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:04.496870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:04.497299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.497992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:04.498437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:04.498850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.535345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:04.535975 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:04.543736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:04.544536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:04.545000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.545715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:04.546442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:04.547036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.705850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:04.713223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2c15981e-f936-4a04-97f2-425b4c45e1a2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1663 microversion: 2.1 time: 0.228280 Aug 31 19:23:04.717447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 415/873] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:04 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1663 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:04.736177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:04.744631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b3d8d505-9b81-4fcf-9c15-5343f74fe085 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.214142 Aug 31 19:23:04.750607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 459/874] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:04 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:04.783320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:04.783992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:04.790572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:04.790988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:04.791420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.792515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:04.793198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:04.793693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:04.813268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 HTTP/1.1 Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:23:04.815610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:23:04.817269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '9952e4e3-5b71-4512-8bc4-cd0339fc24c7'} Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:04.818439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:23:04.819964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:04.822133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:04.822133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-419581ab-6854-4ff4-b9ed-d03a984807f4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 404 len: 111 microversion: 2.1 time: 0.038401 Aug 31 19:23:04.822133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 416/875] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:04 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:23:04.825908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8a91fe8b-205b-4e2d-bf44-78be8707d1be tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '.version_select at 0x7f97632eb430>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:04.845979 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8a91fe8b-205b-4e2d-bf44-78be8707d1be tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014196407" status: 202 len: 0 microversion: 2.1 time: 0.023736 Aug 31 19:23:04.846551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 460/876] 10.222.0.95 () {58 vars in 1221 bytes} [Wed Aug 31 19:23:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014196407 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:23:05.553322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dab6ba53-153b-4305-a758-1a0751fee494 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: .version_select at 0x7f975fbd25e0>, body: {"keypair": {"name": "tempest-keypair-1390642389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePyR96EYYWjNBGj/d7BcEvZ4AaMRr/hcSokrlLc+gOM1UnbvDhB6lRZ2bRFVE8haZVL3zdlxipDlo77+aGiPwxRK8c6bs0ebJNtu2ESv5OERngE9EAaw/g5rZC6rCVzw=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:05.569250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-dab6ba53-153b-4305-a758-1a0751fee494 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:23:05.572999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-dab6ba53-153b-4305-a758-1a0751fee494 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:23:05.595646 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dab6ba53-153b-4305-a758-1a0751fee494 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046022 Aug 31 19:23:05.596237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 417/877] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:23:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:05.741808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:05.742636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:05.755394 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:05.755891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:05.756327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:05.757064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:05.757520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:05.757944 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:05.766949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:05.767558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:05.774201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:05.774936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:05.775691 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:05.776532 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:05.777160 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:05.777665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:06.001908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:06.006191 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:06.014321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d0047741-6b9f-4417-890b-4a5a215d3fc2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1667 microversion: 2.1 time: 0.278050 Aug 31 19:23:06.015575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 461/878] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:05 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1667 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:06.019864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e21a0c1e-19b5-419b-ad14-9414bb9a0ab7 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.256762 Aug 31 19:23:06.020842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 418/879] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:05 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:06.984545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1081875868", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65051338-00b4-459c-8f05-d190e2d29e4b"}], "security_groups": [{"name": "tempest-securitygroup--5381471"}], "key_name": "tempest-keypair-1390642389", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:07.002416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79abc7ba-c581-42eb-a548-332b67afa387"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:07.004986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:07.011583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:07.011848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:07.012320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:07.013020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:07.013936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:07.014368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:07.122491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] validate_networks() for [('65051338-00b4-459c-8f05-d190e2d29e4b', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:23:07.955414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:23:07.955902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:23:07.956374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:23:07.956816 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:23:07.957228 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:23:07.966394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:07.966876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:07.967306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:07.968029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:07.968479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:07.968947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:07.986825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:23:07.990796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:23:08.002214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:23:08.004667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:23:08.054809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a7e24ac7-fa94-4dfd-9abf-a0afbec1d5e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.076248 Aug 31 19:23:08.055458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 419/880] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:23:06 2022] POST /compute/v2.1/servers => generated 399 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:23:08.059940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:08.060547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:08.067585 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:08.068066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:08.068497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:08.069213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:08.069665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:08.070085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:08.215017 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:08.223823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f480d326-7c09-4dc6-8383-18f191757bda tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.167348 Aug 31 19:23:08.224391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 420/881] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:08 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:08.229910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8cbeb8e7-b977-4c55-ad9d-e48a161bb33d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:08.230713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8cbeb8e7-b977-4c55-ad9d-e48a161bb33d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:08.289700 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8cbeb8e7-b977-4c55-ad9d-e48a161bb33d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:08.296411 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8cbeb8e7-b977-4c55-ad9d-e48a161bb33d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1242 microversion: 2.1 time: 0.070234 Aug 31 19:23:08.297025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 421/882] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:08 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:09.245572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:09.246335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:09.255370 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.255863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.256746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.257163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.257624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.258049 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.412154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:09.421820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4f76d0cc-d9c9-4516-93c7-64662cea850f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.180068 Aug 31 19:23:09.422402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 422/883] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:09 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:09.443566 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:09.444174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:09.450229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.450709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.451149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.451838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.452293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.452746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.490673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-db51795c-84c6-48f1-ada8-fa186856bfe6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.632293 Aug 31 19:23:09.491637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 462/884] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:23:06 2022] POST /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments => generated 194 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:09.528162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:09.537470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-27f69998-2b6c-453e-aed4-49411f71fad9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1238 microversion: 2.1 time: 0.098800 Aug 31 19:23:09.538354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 423/885] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:09 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1238 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:10.407848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1236722381", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "networks": [{"uuid": "ee9b76b7-ab75-440b-80c6-10d48a1b8c28"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:10.447593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:10.448201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:10.455809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:10.456287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:10.463978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:10.464797 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:10.465250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:10.465678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:10.472307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] validate_networks() for [('ee9b76b7-ab75-440b-80c6-10d48a1b8c28', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:23:10.683980 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:10.693898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8791ba95-5586-453a-9bf4-d251aa7db49d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.250058 Aug 31 19:23:10.694552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 424/886] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:10 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:10.699213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:10.699818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:10.706986 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:10.707468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:10.707901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:10.708681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:10.709166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:10.709586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:10.787397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:10.795135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3c340a04-c45e-471c-a5a7-3f617782d68a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1294 microversion: 2.1 time: 0.099601 Aug 31 19:23:10.795710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 425/887] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:10 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:10.973169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:23:10.973726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:23:10.974148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:23:10.974565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:23:10.974974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:23:10.985264 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:10.985750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:10.986181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:10.986909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:10.987360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:10.987990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.006437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Getting quotas for project 3b530b6cef6943ee93e561b05d1f846d. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:23:11.011280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Getting quotas for user 1e04230bb5b34b27aad5c2a46230a5cc and project 3b530b6cef6943ee93e561b05d1f846d. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:23:11.025773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:23:11.028171 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:23:11.082182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6a43c0c0-eabb-4bec-8538-ae4b6b0ce160 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678968 Aug 31 19:23:11.083384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 463/888] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:23:11.093973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-79f911ec-e2cc-44ab-bdee-bcd386a55a15 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:11.094913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-79f911ec-e2cc-44ab-bdee-bcd386a55a15 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:11.178204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-79f911ec-e2cc-44ab-bdee-bcd386a55a15 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:11.185914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-79f911ec-e2cc-44ab-bdee-bcd386a55a15 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1219 microversion: 2.1 time: 0.095880 Aug 31 19:23:11.187173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 426/889] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:11 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:11.715542 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:11.716167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:11.725878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:11.726355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:11.726787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.727498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:11.727942 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:11.728544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.816512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:11.817477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:11.824128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:11.824758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:11.825195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.825892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:11.826345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:11.826773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:11.908477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:11.917229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-18daea4d-2468-4902-a932-e265aecd6187 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1300 microversion: 2.1 time: 0.105033 Aug 31 19:23:11.917806 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 427/890] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:11 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:11.928225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:11.936972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-065ec348-d739-4f6d-9848-2247ae4e4544 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.225505 Aug 31 19:23:11.937556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 464/891] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:11 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:12.210248 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:12.211191 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:12.217347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.217827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.218275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.218951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.219406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.220493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.286807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:12.294558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4a827875-b9df-42a0-b7c6-5cb5d8d2ed3d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1215 microversion: 2.1 time: 0.088356 Aug 31 19:23:12.295243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 428/892] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:12 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:12.938001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:12.938857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:12.946466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.946963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.947389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.948101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.948547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.948983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.959093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:12.959655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:12.965570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.966047 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.966478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.967162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:12.967636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:12.968037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:12.972304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:13.147549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:13.151193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:13.156639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-aaffce3c-59c3-4ef5-a73a-439000b66e25 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.222393 Aug 31 19:23:13.157216 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 465/893] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:12 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:13.157970 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:13.165832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-703db020-06c0-4267-80ad-b2426f47fb78 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.210731 Aug 31 19:23:13.166390 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 429/894] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:12 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:13.316678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:13.317290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:13.324335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:13.324841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:13.325283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:13.325992 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:13.326448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:13.326872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:13.397943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:13.410463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-42ad45f8-d6f1-46bc-8768-4f65616ebcb4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1215 microversion: 2.1 time: 0.096688 Aug 31 19:23:13.411699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 466/895] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:13 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:14.182262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:14.182886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:14.190275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.190768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.191199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.191889 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.192896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.193476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.234085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-a4cf4d07-b3c2-4937-a310-4d7fcffcf235 req-d5d7d5ea-6ec8-404f-9eb0-4acb8c4e9b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74c7954-70b5-4071-a5d4-af844041d3bd", "tag": "7abff4ac-3acb-46f3-8fa0-6b910a3538fa"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:14.245367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a4cf4d07-b3c2-4937-a310-4d7fcffcf235 req-d5d7d5ea-6ec8-404f-9eb0-4acb8c4e9b13 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.245927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a4cf4d07-b3c2-4937-a310-4d7fcffcf235 req-d5d7d5ea-6ec8-404f-9eb0-4acb8c4e9b13 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.246653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-a4cf4d07-b3c2-4937-a310-4d7fcffcf235 req-d5d7d5ea-6ec8-404f-9eb0-4acb8c4e9b13 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.259446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-a4cf4d07-b3c2-4937-a310-4d7fcffcf235 req-d5d7d5ea-6ec8-404f-9eb0-4acb8c4e9b13 service nova] Creating event network-changed:7abff4ac-3acb-46f3-8fa0-6b910a3538fa for instance a74c7954-70b5-4071-a5d4-af844041d3bd on hv-cinder-85221 Aug 31 19:23:14.264525 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-a4cf4d07-b3c2-4937-a310-4d7fcffcf235 req-d5d7d5ea-6ec8-404f-9eb0-4acb8c4e9b13 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103253 Aug 31 19:23:14.265189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 430/896] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:14.272019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:14.272840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:14.274869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:14.280881 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.281362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.281799 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.283276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.283751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.284178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.374113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:14.388921 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd5ba78d-ae3d-4d0c-8ce1-fffbc48c708a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.214288 Aug 31 19:23:14.390898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 467/897] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:14 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:14.432799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:14.433403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:14.440503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.441027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.441218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:14.441494 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.442221 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:14.442680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:14.443109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:14.449216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cdf0e9df-90f9-4ae7-85f6-9ff962e70968 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.181722 Aug 31 19:23:14.449922 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 431/898] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:14 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:14.513654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:14.534692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c1b27d34-17a1-4372-a922-08da96b5da31 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1271 microversion: 2.1 time: 0.105565 Aug 31 19:23:14.535266 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 468/899] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:14 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:15.419424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:15.420349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:15.426381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.426865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.427295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.427984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.428428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.428868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.471422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:15.472662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:15.479196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.479845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.480433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.481189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.481630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.482374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.654027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:15.662605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e9297dbb-d5fb-4e31-ad1a-bf5c0a7de49a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.247086 Aug 31 19:23:15.663173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 432/900] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:15 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:15.668130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:15.669092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:15.675499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.676193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.676837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.677527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.677976 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.678386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.697498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:15.707154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c44b8c56-41d6-48b1-acab-72070e1fce8e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1568 microversion: 2.1 time: 0.240261 Aug 31 19:23:15.707739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 469/901] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:15 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:15.728162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:15.728943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:15.737010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.737990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.738645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.739622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.740292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.741072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.772190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120706) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:23:15.822287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:15.831311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-543f6ff8-3069-4bc3-9f59-f48b903f978a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.166824 Aug 31 19:23:15.848874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c1c7af59-98d1-44d9-a4fd-e46e896a36bf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "POST /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52/action" status: 202 len: 0 microversion: 2.1 time: 0.124497 Aug 31 19:23:15.849516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 470/902] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:23:15 2022] POST /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:23:15.858304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:15.858850 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:15.860246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 433/903] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:15 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:15.867977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.867977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.868249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:15.868768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:15.869669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:15.870113 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.042341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:16.051499 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2b733381-50df-4f16-9c69-3535f5176c3e tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1516 microversion: 2.1 time: 0.197554 Aug 31 19:23:16.060695 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 471/904] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:15 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:16.413287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-f9fcb062-dc59-41df-8a36-685b96ac8660 req-6bbd02da-3f8d-4f0f-bc90-47ae33606f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b78af99-475c-4400-a557-0a9687987357", "tag": "33ea59b2-756f-464d-a33a-7fb9bee153e1"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:16.422568 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f9fcb062-dc59-41df-8a36-685b96ac8660 req-6bbd02da-3f8d-4f0f-bc90-47ae33606f3a service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.424422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f9fcb062-dc59-41df-8a36-685b96ac8660 req-6bbd02da-3f8d-4f0f-bc90-47ae33606f3a service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.424422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f9fcb062-dc59-41df-8a36-685b96ac8660 req-6bbd02da-3f8d-4f0f-bc90-47ae33606f3a service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.435427 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-f9fcb062-dc59-41df-8a36-685b96ac8660 req-6bbd02da-3f8d-4f0f-bc90-47ae33606f3a service nova] Creating event network-changed:33ea59b2-756f-464d-a33a-7fb9bee153e1 for instance 6b78af99-475c-4400-a557-0a9687987357 on hv-cinder-85221 Aug 31 19:23:16.441878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-f9fcb062-dc59-41df-8a36-685b96ac8660 req-6bbd02da-3f8d-4f0f-bc90-47ae33606f3a service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033398 Aug 31 19:23:16.442638 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 434/905] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:23:16.683379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:16.683924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:16.692199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.692199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.692637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.693297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.693752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.694185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.827115 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:16.834759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-39fb2f1d-e13e-426c-9142-9b5ce862086e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.155306 Aug 31 19:23:16.835316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 472/906] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:16 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:16.854811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:16.855526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:16.862662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.863134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.863562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.864238 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:16.864746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:16.865164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:16.996100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:17.004247 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-38e4f59c-4a8b-41bf-9138-79e77cdb0363 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.153506 Aug 31 19:23:17.004872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 435/907] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:16 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:17.073800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:17.074438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:17.080604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.081076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.081503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:17.082188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.082637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.083058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:17.215119 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:17.223608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4f066f43-9ece-435d-bb11-3e6e659e9a27 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1516 microversion: 2.1 time: 0.153700 Aug 31 19:23:17.224186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 473/908] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:17 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:17.817601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-f66d4420-1e6e-4388-90ea-d0c75e77f9f0 req-78eccf32-9558-4eb3-a811-36b1bf17e314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "name": "network-vif-unplugged", "status": "completed", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:17.827376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f66d4420-1e6e-4388-90ea-d0c75e77f9f0 req-78eccf32-9558-4eb3-a811-36b1bf17e314 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.827849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f66d4420-1e6e-4388-90ea-d0c75e77f9f0 req-78eccf32-9558-4eb3-a811-36b1bf17e314 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.828270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f66d4420-1e6e-4388-90ea-d0c75e77f9f0 req-78eccf32-9558-4eb3-a811-36b1bf17e314 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:17.839854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.compute.server_external_events [req-f66d4420-1e6e-4388-90ea-d0c75e77f9f0 req-78eccf32-9558-4eb3-a811-36b1bf17e314 service nova] Unable to find a host for instance a83d3294-0902-4f21-a7b9-45b2b5229c52. Dropping event network-vif-unplugged {{(pid=120707) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 19:23:17.840877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-f66d4420-1e6e-4388-90ea-d0c75e77f9f0 req-78eccf32-9558-4eb3-a811-36b1bf17e314 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027575 Aug 31 19:23:17.841443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 436/909] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 19:23:17.855173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:17.855951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:17.862354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.862840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.863276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:17.863971 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:17.864422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:17.864880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:18.003935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:18.011565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-989b54f2-e24b-4806-8d7b-7faf5859075c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.160255 Aug 31 19:23:18.012139 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 474/910] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:17 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:18.024309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:18.024940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:18.026914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:18.032544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:18.033012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:18.033456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:18.034143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:18.034854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:18.035279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:18.200039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:18.212932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2536c27-08e2-4ad4-950d-23bf81becb5b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.191338 Aug 31 19:23:18.224611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 437/911] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:18 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:18.245559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:18.246343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:18.253887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:18.254707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:18.255249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:18.256049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:18.256546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:18.257069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:18.397672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:18.408781 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7bd794c1-e8ea-4400-8dad-7ae64b6ba1ce tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1518 microversion: 2.1 time: 0.166521 Aug 31 19:23:18.409984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 475/912] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:18 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:19.035125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:19.035814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:19.041713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.042183 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.042611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.043292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.043737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.044153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.190083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.197763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-36c3124b-6f17-49c9-b973-e1ff1ac7ce56 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.167701 Aug 31 19:23:19.198332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 438/913] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:19 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:19.237147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:19.237871 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:19.243070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:19.244811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.245289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.245433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:19.245764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.246500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.246949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.247368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.251411 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.251967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.252405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.253215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.253688 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.254123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.277014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'flavor' on Instance uuid 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:19.384363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.392625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2db55ad1-6f5e-4445-9154-a9bb63ac77a6 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.160996 Aug 31 19:23:19.393290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 476/914] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:19 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:19.404943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-09ea190b-fd5b-4422-9633-05b51248d7c3 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/action" status: 200 len: 32 microversion: 2.1 time: 0.167347 Aug 31 19:23:19.405530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 439/915] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:23:19 2022] POST /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 19:23:19.415585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:19.416184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:19.422194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.423284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.423858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.424688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.425007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.425430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.431143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:19.431585 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:19.437689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.438174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.438850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.439550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:19.440009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:19.440433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:19.627629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.632027 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:19.636152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2d50f698-2848-4c6e-b8d4-4dd0a48c6620 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.224302 Aug 31 19:23:19.636903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 477/916] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:19 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:19.640404 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5d76e6a2-1e57-4dab-9933-598b4ddcff9a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1518 microversion: 2.1 time: 0.213592 Aug 31 19:23:19.640998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 440/917] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:19 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:20.219886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:20.220688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:20.227573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.228069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.228510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.229336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.229799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.230228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.382664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.393822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f0113d07-c873-4d4e-86e6-e08ceeb15033 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.177608 Aug 31 19:23:20.402477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 478/918] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:20 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:20.415533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:20.416133 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:20.421946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.422419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.423082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.423876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.424725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.425170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.591304 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.600616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0cab75c-2f61-46f1-b37f-cb75f28f876b tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.188900 Aug 31 19:23:20.601473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 441/919] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:20 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:20.662944 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:20.663727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:20.663870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:20.664481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:20.669823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.670580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.670954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.671306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.671445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.671843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.672324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.672527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:20.672851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.672978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:20.673417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.673546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:20.880849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.883963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:20.889597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7332f6e-4951-476b-b141-554395377b82 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.230789 Aug 31 19:23:20.890344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 479/920] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:20 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:20.894065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0ed64b27-1ef2-47cd-a02a-8ad760cc82be tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.233809 Aug 31 19:23:20.894775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 442/921] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:20 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:21.415881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:21.416501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:21.418415 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:21.419515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:21.426296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.426779 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.427218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.427916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.428373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.428830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.570156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:21.578020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-165dc536-a3b0-4dce-97d9-1d424eeee744 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.166244 Aug 31 19:23:21.578584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 480/922] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:21 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:21.623044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:21.623641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:21.625590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=14 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:21.631604 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.632079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.632507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.633216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.633659 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.634073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.774390 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:21.784108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5576f9ff-05f8-4109-a39a-2b5bce00ee6a tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.164843 Aug 31 19:23:21.785077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 443/923] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:21 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:21.922014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:21.923054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:21.931075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.934582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.935307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.936849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:21.937814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.938698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.939560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:21.940229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.953671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.955097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.956581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.956581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:21.963037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:21.963520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:21.983153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:22.205761 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.210924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.214064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4ed5d450-4ee7-4f72-9e62-fbbaadbdc7ec tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.296798 Aug 31 19:23:22.214669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 481/924] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:21 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:22.219085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e0f2f2ae-8263-42e8-92ba-908039fd4894 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.291800 Aug 31 19:23:22.219265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-b7f1865f-1b66-47cf-bbf3-9e63e0cb970e req-e2cf9b5f-13f9-4a76-b739-96df526daff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74c7954-70b5-4071-a5d4-af844041d3bd", "name": "network-vif-plugged", "status": "completed", "tag": "7abff4ac-3acb-46f3-8fa0-6b910a3538fa"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:22.229402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b7f1865f-1b66-47cf-bbf3-9e63e0cb970e req-e2cf9b5f-13f9-4a76-b739-96df526daff6 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.229878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b7f1865f-1b66-47cf-bbf3-9e63e0cb970e req-e2cf9b5f-13f9-4a76-b739-96df526daff6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.230310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b7f1865f-1b66-47cf-bbf3-9e63e0cb970e req-e2cf9b5f-13f9-4a76-b739-96df526daff6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.232924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 444/925] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:21 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:22.241313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-b7f1865f-1b66-47cf-bbf3-9e63e0cb970e req-e2cf9b5f-13f9-4a76-b739-96df526daff6 service nova] Creating event network-vif-plugged:7abff4ac-3acb-46f3-8fa0-6b910a3538fa for instance a74c7954-70b5-4071-a5d4-af844041d3bd on hv-cinder-85221 Aug 31 19:23:22.246321 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-b7f1865f-1b66-47cf-bbf3-9e63e0cb970e req-e2cf9b5f-13f9-4a76-b739-96df526daff6 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030566 Aug 31 19:23:22.246895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 482/926] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:22.600151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:22.600789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:22.606788 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.607289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.607716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.608406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.608892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.609314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.749832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.754165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:22.761357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eea224a0-a0e2-4c58-a890-f2dd25731937 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.164691 Aug 31 19:23:22.762348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 445/927] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:22 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:22.807168 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:22.807863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:22.814845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.815349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.815778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.816709 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:22.817288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:22.817716 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:22.952392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:22.960622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6e916444-5f6a-4961-b0ff-a1279f4575c4 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.158880 Aug 31 19:23:22.961188 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 483/928] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:22 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:23.236115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:23.236757 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:23.241452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:23.242060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:23.243666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.244146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.244598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.245287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.245843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.246297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.247886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.248363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.248840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.249536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.249986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.250409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.450288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:23.453269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:23.458797 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9e1b4a1f-44e1-41a1-a948-c03203cced6f tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.221129 Aug 31 19:23:23.459511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 484/929] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:23 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:23.462292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ae89c593-9c10-481d-b6e8-ddfec88109f6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.229990 Aug 31 19:23:23.462858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 446/930] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:23 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:23.784092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:23.784924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:23.791204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.792314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.792790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.793638 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.793930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.794351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.927513 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:23.935184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bc57099d-6f29-4529-b5cc-8d179a825116 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.155880 Aug 31 19:23:23.935764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 485/931] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:23 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:23.981982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:23.982588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:23.990135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.990872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.991310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:23.992013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:23.992467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:23.992917 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.125582 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:24.133517 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e138b4ab-a0be-489d-905a-f67d2aa3ab5e tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.155932 Aug 31 19:23:24.134079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 447/932] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:23 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:24.260108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-54d9fdf5-c2c3-4631-a57c-3aae3ba41748 req-f37ad265-1d28-487f-81aa-bc0b6e46efde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b78af99-475c-4400-a557-0a9687987357", "name": "network-vif-plugged", "status": "completed", "tag": "33ea59b2-756f-464d-a33a-7fb9bee153e1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:24.270525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-54d9fdf5-c2c3-4631-a57c-3aae3ba41748 req-f37ad265-1d28-487f-81aa-bc0b6e46efde service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.270996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-54d9fdf5-c2c3-4631-a57c-3aae3ba41748 req-f37ad265-1d28-487f-81aa-bc0b6e46efde service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.271425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-54d9fdf5-c2c3-4631-a57c-3aae3ba41748 req-f37ad265-1d28-487f-81aa-bc0b6e46efde service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.282814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-54d9fdf5-c2c3-4631-a57c-3aae3ba41748 req-f37ad265-1d28-487f-81aa-bc0b6e46efde service nova] Creating event network-vif-plugged:33ea59b2-756f-464d-a33a-7fb9bee153e1 for instance 6b78af99-475c-4400-a557-0a9687987357 on hv-cinder-85221 Aug 31 19:23:24.288950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-54d9fdf5-c2c3-4631-a57c-3aae3ba41748 req-f37ad265-1d28-487f-81aa-bc0b6e46efde service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032445 Aug 31 19:23:24.289531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 486/933] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:24.480837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:24.481448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:24.483586 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:24.484289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:24.487912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.488392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.488853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.489545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.489990 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.490409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.490992 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.491478 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.491918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.492646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.493104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.493559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.680910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:24.687829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:24.688973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4dbf1e95-f885-49a0-b56e-d6b060bf0edd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.212121 Aug 31 19:23:24.689786 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 448/934] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:24 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:24.696143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f947fc95-97f5-40c4-96f7-7287f0c913ad tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.216770 Aug 31 19:23:24.696870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 487/935] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:24 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:24.956134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:24.956646 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:24.962471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.962950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.963383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:24.964070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:24.964523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:24.965255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.106672 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.115080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bb8f0dd0-f271-4119-ad91-3f1cf5ca0693 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1365 microversion: 2.1 time: 0.163414 Aug 31 19:23:25.115734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 449/936] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:24 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:25.154402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:25.155425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:25.163527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.164017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.164473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.165258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.165715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.166140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.305568 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.313848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6eccab51-2b12-4c6a-bfec-a4bf72a6e1af tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.163016 Aug 31 19:23:25.314432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 488/937] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:25 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:25.709932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:25.710463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:25.716468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.716981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.717243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:25.717413 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.717861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:25.718104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.718553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.718976 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.723907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.724385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.724857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.725553 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:25.726007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:25.726441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:25.912261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.916189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:25.920188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-adacb6fa-f848-49cd-8a12-67e1f96cb6e3 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.214195 Aug 31 19:23:25.920788 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 450/938] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:25 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:25.925037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-81d76f62-aaeb-45d3-924f-cd6f445966a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.211764 Aug 31 19:23:25.925606 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 489/939] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:25 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:26.136819 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:26.137551 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:26.144363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.144903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.145331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.146024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.146468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.146882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.277346 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:26.285428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a3dcc2b8-c5ec-42fd-a8f2-27346462376d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1554 microversion: 2.1 time: 0.152458 Aug 31 19:23:26.285995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 451/940] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:26 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:26.305241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:26.305743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:26.311868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.312342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.312814 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.314107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.314555 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.314970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.334579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:26.335184 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:26.341035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.341512 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.341945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.342629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.343078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.343497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.404138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-117f26c6-5f13-40c8-9712-8d3b81b993ac tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102324 Aug 31 19:23:26.405277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 490/941] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:23:26 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:26.499052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:26.506951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5c3251af-516d-49a4-a639-bb58896534ec tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1319 microversion: 2.1 time: 0.176099 Aug 31 19:23:26.507519 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 452/942] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:26 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:26.942373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:26.943286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:26.946589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:26.947205 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:26.949452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.949938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.950552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.951260 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.951707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.952312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.953277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.953862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.954302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:26.955001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:26.955624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:26.956061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.152923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:27.162087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9c1619ae-93ef-42d8-980a-1026e7d82e46 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.219321 Aug 31 19:23:27.162757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:27.162932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 453/943] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:26 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:27.173293 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-86fa149d-0c1d-43ab-8168-c0aaaa9098fd tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.234082 Aug 31 19:23:27.174219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 491/944] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:26 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:27.529011 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:27.529758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:27.537767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.538276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.538908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.539649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.540257 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.540707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.620123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-93a47970-ee56-42de-834b-3e619e848a22 req-a636bf56-cacc-4f74-b3e3-5f45a3a78f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74c7954-70b5-4071-a5d4-af844041d3bd", "tag": "7abff4ac-3acb-46f3-8fa0-6b910a3538fa"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:27.631528 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-93a47970-ee56-42de-834b-3e619e848a22 req-a636bf56-cacc-4f74-b3e3-5f45a3a78f8b service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.632010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-93a47970-ee56-42de-834b-3e619e848a22 req-a636bf56-cacc-4f74-b3e3-5f45a3a78f8b service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.632444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-93a47970-ee56-42de-834b-3e619e848a22 req-a636bf56-cacc-4f74-b3e3-5f45a3a78f8b service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.645313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-93a47970-ee56-42de-834b-3e619e848a22 req-a636bf56-cacc-4f74-b3e3-5f45a3a78f8b service nova] Creating event network-changed:7abff4ac-3acb-46f3-8fa0-6b910a3538fa for instance a74c7954-70b5-4071-a5d4-af844041d3bd on hv-cinder-85221 Aug 31 19:23:27.650242 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-93a47970-ee56-42de-834b-3e619e848a22 req-a636bf56-cacc-4f74-b3e3-5f45a3a78f8b service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034053 Aug 31 19:23:27.650839 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 492/945] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:27.709515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:27.717656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0cd79381-b572-4c72-b029-02e65b726eef tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1507 microversion: 2.1 time: 0.192628 Aug 31 19:23:27.718245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 454/946] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:27 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:27.739686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ce7cdb3-73e5-4235-a580-97dc05515d13", "device": "/dev/sdb"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:27.742191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:27.750127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.751359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.751966 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:27.753255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:27.753924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:27.754364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.210251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:28.210770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:28.216729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.217212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.217640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.218325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.218779 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.219738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.249696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-60836d94-671e-4d6c-aade-d13b66aab28a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments/fd07b82d-8b32-49c0-9899-d62ece49e0e5" status: 200 len: 194 microversion: 2.20 time: 0.154259 Aug 31 19:23:28.250266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 455/947] 10.222.0.95 () {60 vars in 1454 bytes} [Wed Aug 31 19:23:28 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments/fd07b82d-8b32-49c0-9899-d62ece49e0e5 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:23:28.254747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:28.255346 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:28.262203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.262577 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.262988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.263684 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.264134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.264553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.402092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:28.411635 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7b5f7b8a-3882-4a54-93b0-146cdf4327c8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.160347 Aug 31 19:23:28.412208 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 456/948] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:28 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:28.416680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:28.417493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:28.424299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.424807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.425413 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.426294 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.426938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.427366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.600480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:28.608278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-944393e3-9ea8-48e2-a017-8bf7b50d1788 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.195073 Aug 31 19:23:28.608886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 457/949] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:28 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:28.614983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:28.615480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:28.623169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.623658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.624115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.624973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.625467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.626797 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.723603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'services' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:28.808497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4a1d9aa9-dec9-46db-afa8-c00f4bf7c58e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments/fd07b82d-8b32-49c0-9899-d62ece49e0e5" status: 202 len: 0 microversion: 2.20 time: 0.198344 Aug 31 19:23:28.809130 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 458/950] 10.222.0.95 () {60 vars in 1457 bytes} [Wed Aug 31 19:23:28 2022] DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments/fd07b82d-8b32-49c0-9899-d62ece49e0e5 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:23:28.819959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:28.822341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:28.831265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.832079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.832842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.834044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:28.834755 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:28.835447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:28.867602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1943c878-4899-4147-b95d-1c853ea0dbf0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052766 Aug 31 19:23:28.868086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 459/951] 10.222.0.95 () {60 vars in 1343 bytes} [Wed Aug 31 19:23:28 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:23:29.118651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ff03c35a-dbe3-4323-b675-c178e0523a99 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "POST /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.383350 Aug 31 19:23:29.126332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 493/952] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:23:27 2022] POST /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357/os-volume_attachments => generated 194 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:29.434282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:29.434956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:29.441317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.441789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.442212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.442920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.443366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.443781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.576794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:29.586112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e35736fb-8ca5-4cbe-bfe8-6c7fafbcb107 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.155662 Aug 31 19:23:29.586689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 460/953] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:29 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:29.636314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:29.637034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:29.643257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.643736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.644161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.644893 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.645343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.647998 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.811376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:29.819974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c815abd8-0e04-4fe4-80d8-b1fb5d3ecd39 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.188319 Aug 31 19:23:29.820477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 494/954] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:29 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:29.883627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:29.887464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:29.894292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.894775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.895209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.895923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:29.896365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:29.896805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:29.926559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:29.933278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-95c5a8ed-462c-4cc2-9112-5b88093ff67a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055307 Aug 31 19:23:29.938853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 461/955] 10.222.0.95 () {60 vars in 1343 bytes} [Wed Aug 31 19:23:29 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:23:30.608517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:30.609994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:30.616773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.617253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.617681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.618375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.618830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.619302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.757872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:30.768549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-11ccbaa2-6b3a-4e7f-bc65-15d913c4ebfc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.163754 Aug 31 19:23:30.769168 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 495/956] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:30 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:30.841942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:30.842594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:30.849923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.850373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.850807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.851505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.851956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.852378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.950463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:30.953300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:30.963644 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.964471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.965127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:30.965877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:30.966381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:30.966805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.005962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-13992c53-c360-40bb-bea9-95195bb805e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062764 Aug 31 19:23:31.007269 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 496/957] 10.222.0.95 () {60 vars in 1343 bytes} [Wed Aug 31 19:23:30 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:31.028242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.039210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d691df25-0678-4d73-bcfb-1b52677e75d0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.201157 Aug 31 19:23:31.039485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 462/958] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:30 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:31.077805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:31.078296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:31.081827 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:31.085806 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:31.086279 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:31.086708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.087401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:31.087845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:31.088337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.117013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:23:31.164387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:31.198489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8c2b1765-83ff-4930-a70f-4b946122ee6f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 204 len: 0 microversion: 2.20 time: 0.124387 Aug 31 19:23:31.199193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 497/959] 10.222.0.95 () {60 vars in 1280 bytes} [Wed Aug 31 19:23:31 2022] DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:23:31.208255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:31.209092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:31.224879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:31.225367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:31.225804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.226503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:31.227079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:31.227527 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.366765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.377102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.379637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.380811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b8893028-bd20-40e5-b82b-bac805145c23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.177162 Aug 31 19:23:31.381359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 463/960] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:31 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:31.791805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:31.792703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:31.799215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:31.799700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:31.800143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.800890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:31.801343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:31.801768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:31.939451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:31.947868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e5d0f394-38ca-4934-92ed-aa5549b88765 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.160325 Aug 31 19:23:31.948433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 498/961] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:31 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:32.065297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:32.066116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:32.074436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.074911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.075341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.076036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.076478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.076922 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.217501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.225643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ee8872f3-f675-420e-89f9-4430c818270a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.167883 Aug 31 19:23:32.226286 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 464/962] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:32 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:32.406805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:32.407556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:32.414169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.414917 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.415509 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.416216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.416778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.417117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.461360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-00c58a8b-a314-4709-b8a0-f1b88e52d82d req-b6f979c9-382e-4774-b173-b0b14f796a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "name": "network-vif-plugged", "status": "completed", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:32.473619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-00c58a8b-a314-4709-b8a0-f1b88e52d82d req-b6f979c9-382e-4774-b173-b0b14f796a2e service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.474093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-00c58a8b-a314-4709-b8a0-f1b88e52d82d req-b6f979c9-382e-4774-b173-b0b14f796a2e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.474520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-00c58a8b-a314-4709-b8a0-f1b88e52d82d req-b6f979c9-382e-4774-b173-b0b14f796a2e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.485895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-00c58a8b-a314-4709-b8a0-f1b88e52d82d req-b6f979c9-382e-4774-b173-b0b14f796a2e service nova] Creating event network-vif-plugged:facbf5d7-797a-4f5f-8a68-930bc7130258 for instance a83d3294-0902-4f21-a7b9-45b2b5229c52 on hv-cinder-85221 Aug 31 19:23:32.490909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-00c58a8b-a314-4709-b8a0-f1b88e52d82d req-b6f979c9-382e-4774-b173-b0b14f796a2e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108684 Aug 31 19:23:32.491551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 499/963] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:23:32.555373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.563842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.565408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:32.566570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d3514432-9c12-4cf7-ab07-b7fa5990129e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.164411 Aug 31 19:23:32.567220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 465/964] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:32 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:32.970394 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:32.971110 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:32.977262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.977737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.978167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:32.978882 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:32.979329 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:32.979750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.113240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.121448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-de9f0ad7-5f0f-4169-9ebd-7783422274e4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.155338 Aug 31 19:23:33.122007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 500/965] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:32 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:33.247053 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:33.247584 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:33.254675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:33.255151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:33.255590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.256283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:33.256774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:33.257196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.393117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.400978 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b3bc84dc-4779-47de-b483-73da023d2f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.157874 Aug 31 19:23:33.401547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 466/966] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:33 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:33.590633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:33.591241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:33.598778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:33.599261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:33.599696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.600384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:33.600860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:33.601283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:33.735617 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.743888 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.745347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:33.746597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1f7cea10-3b50-4c3e-aa26-55b4f900c7bc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.160104 Aug 31 19:23:33.747146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 501/967] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:33 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:34.144201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:34.144853 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:34.150894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.151373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.151805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.152488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.152974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.153396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.286519 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.294668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6097c40d-4e77-4083-98ad-639498934a18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.155208 Aug 31 19:23:34.295225 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 467/968] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:34 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:34.422484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:34.423090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:34.429082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.429564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.430004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.430698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.431152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.431578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.573574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.582229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f18871bb-c6a7-4448-818d-838ac33dbcb0 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.163635 Aug 31 19:23:34.582794 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 502/969] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:34 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:34.769327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:34.769930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:34.776030 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.776736 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.777322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.778193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:34.778642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:34.779059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:34.917075 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.925899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.927573 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:34.928459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4852c5fd-afa1-4793-8b7b-5cffe2f9fff3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1720 microversion: 2.20 time: 0.163149 Aug 31 19:23:34.929229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 468/970] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:34 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:35.317191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:35.318053 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:35.325816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.326368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.326819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.327527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.328123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.330251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.475385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:35.484419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f6400d8f-a41b-45f7-bd3e-079cdc639275 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.172649 Aug 31 19:23:35.485057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 503/971] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:35 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:35.567449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-d62f9bd2-f665-4308-b72e-da5cd097aa36 req-ad14856f-bd05-4d27-8d5e-56b2665265e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276", "name": "network-vif-deleted", "tag": "967f1389-d0e3-4254-95b9-b3c7a09314ee"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:35.582741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-d62f9bd2-f665-4308-b72e-da5cd097aa36 req-ad14856f-bd05-4d27-8d5e-56b2665265e6 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.584704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-d62f9bd2-f665-4308-b72e-da5cd097aa36 req-ad14856f-bd05-4d27-8d5e-56b2665265e6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.585344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-d62f9bd2-f665-4308-b72e-da5cd097aa36 req-ad14856f-bd05-4d27-8d5e-56b2665265e6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.604397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:35.605325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-d62f9bd2-f665-4308-b72e-da5cd097aa36 req-ad14856f-bd05-4d27-8d5e-56b2665265e6 service nova] Creating event network-vif-deleted:967f1389-d0e3-4254-95b9-b3c7a09314ee for instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 on hv-cinder-85221 Aug 31 19:23:35.605521 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:35.612497 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.613029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.613154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-d62f9bd2-f665-4308-b72e-da5cd097aa36 req-ad14856f-bd05-4d27-8d5e-56b2665265e6 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049700 Aug 31 19:23:35.613468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.614186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.614647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.615195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 469/972] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:35.615815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.816289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:35.824834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a396a06f-71a7-49e7-a60a-75e89e20f731 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.224079 Aug 31 19:23:35.825425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 504/973] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:35 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:35.952401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:35.953165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:35.959678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.960168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.960623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:35.961323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:35.961780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:35.962211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:36.024590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:36.033861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:36.035574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:36.036729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-45451d3c-7785-46b4-9e7b-761ba75fe53e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1366 microversion: 2.20 time: 0.088568 Aug 31 19:23:36.037285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 470/974] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:35 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:36.506254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:36.506872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:36.513696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:36.514116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:36.514556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:36.515257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:36.515719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:36.517080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:36.655083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:36.664290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d015738c-525a-4a3f-9ad2-4b28a4f38e80 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.161743 Aug 31 19:23:36.664743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 505/975] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:36 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:36.849183 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:36.850095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:36.856118 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:36.856609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:36.857046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:36.857721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:36.858164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:36.858580 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:36.991615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:36.999345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fbc8e577-d07b-47a2-ba07-8ef93f399f35 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.154457 Aug 31 19:23:36.999927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 471/976] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:36 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:37.059395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:37.060026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:37.066900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:37.067390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:37.067834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.068561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:37.069042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:37.069501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.136896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.145327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.146986 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.148142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c70d82e1-567e-4af7-b952-018e736e2e7e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1366 microversion: 2.20 time: 0.092736 Aug 31 19:23:37.148724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 506/977] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:37 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:37.684814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:37.685416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:37.691989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:37.692470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:37.692930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.693618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:37.694068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:37.694492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:37.833491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:37.841746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2d3fa16c-c08e-47d0-a2a7-580f7349e6bb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.160776 Aug 31 19:23:37.842313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 472/978] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:37 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:38.021929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:38.022489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.029465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.029959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.030525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.031252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.032125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.032253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.171042 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:38.171651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.177008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.178115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.178660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.179128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.180048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.180490 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.180936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.186484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9d8e4880-8001-4e33-a503-601279e5a138 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.168109 Aug 31 19:23:38.188093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 507/979] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:38 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:38.248001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.257081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.258503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.259662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bf95f020-15c6-4cca-9f3c-46c97910d145 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1366 microversion: 2.20 time: 0.092508 Aug 31 19:23:38.260167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 473/980] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:38 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:38.632337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:38.634718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.641635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.642470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.642908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.643593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.644043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.644460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.717614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6fad30e1-163d-4193-bc83-0c02a304d42d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/action" status: 202 len: 0 microversion: 2.1 time: 0.088910 Aug 31 19:23:38.721640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 508/981] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:23:38 2022] POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:23:38.726669 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:38.727358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.733781 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.734262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.734891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.735625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.736079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.736502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.864200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:38.864926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:38.870973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.871457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.871912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.872606 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:38.873066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:38.873493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:38.879668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:38.887686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b29e0f8d-a59c-4eef-a493-2a1748a36c4c tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.164898 Aug 31 19:23:38.888251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 474/982] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:38 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:39.006764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.014928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-56e078cc-354a-4544-854e-d9ad5dc878ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.155219 Aug 31 19:23:39.015489 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 509/983] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:38 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:39.209446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.210702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.216997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.217485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.217982 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.218621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.219098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.219683 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.283746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.284710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.291371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.291861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.292297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.293035 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.293484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.293906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.368912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.378090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.379547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.380746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0e82e40f-fcea-4249-a347-6e1216e8186a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1366 microversion: 2.20 time: 0.101389 Aug 31 19:23:39.381316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 510/984] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:39 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:39.389607 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:39.398627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4d1bf074-a1d6-4dfd-8056-68b1b12725aa tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1574 microversion: 2.1 time: 0.192953 Aug 31 19:23:39.399202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 475/985] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:39 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:39.909759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:39.910389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:39.916359 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.916870 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.917308 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:39.918005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:39.918460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:39.918890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.036796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:40.037397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:40.043387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.043865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.044297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.045426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.045927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.046542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.081656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.090676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-49537f42-0a53-44ca-9751-061f44149f05 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.185031 Aug 31 19:23:40.091253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 511/986] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:39 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:40.188543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.197834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-852188ee-1473-47d9-9d75-b17eb5c752a0 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.165268 Aug 31 19:23:40.198418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 476/987] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:40 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:40.405867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:40.406954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:40.413624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.414099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.414530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.415213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.415731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.416162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.420627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:40.421230 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:40.427687 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.428159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.428600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.429316 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.429759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.430174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.448728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:40.449209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:40.449645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:40.450087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:40.513263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.521079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.522520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.523665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e87ddd66-60af-4ddb-b670-970ff5656252 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1371 microversion: 2.20 time: 0.121856 Aug 31 19:23:40.524227 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 512/988] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:40 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:40.582640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:40.590224 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-df224517-7e33-4537-af81-5bb01c2da658 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1561 microversion: 2.1 time: 0.173505 Aug 31 19:23:40.590780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 477/989] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:40 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:41.112439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:41.113044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:41.120104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.120849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.121291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.122127 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.122582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.123009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.143799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:41.222169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:41.223013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:41.230890 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.240686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.240686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.240686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.240686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.241367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.628041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:41.631624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:41.636435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8bb40762-4772-48f1-b10e-bab24e33df6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.528895 Aug 31 19:23:41.637034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 513/990] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:41 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:41.642059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:41.642668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:41.643411 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7439c6ba-702a-46d5-ae4e-2c7b2cf891dd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.427254 Aug 31 19:23:41.644093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 478/991] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:41 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:41.648754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.649243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.649680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.650609 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.651023 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.651452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.683784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:41.684173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:41.684639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:41.685087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:41.725829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:41.735109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:41.736646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:41.737815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-80e67347-2850-4d12-bbb5-99e250feb898 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1371 microversion: 2.20 time: 0.099752 Aug 31 19:23:41.738373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 514/992] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:41 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:42.658878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:42.659823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:42.664919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:42.665635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:42.666023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.666513 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.666984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.667679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.668138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.668583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.672232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.673459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:42.674073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.674517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.675409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.675872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.676324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.871345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.877219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.879645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e0a96f18-ce49-4d81-a9e7-c77111de8951 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.218485 Aug 31 19:23:42.880234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 515/993] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:42 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:42.884843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:42.885445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:42.886116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-652ff135-4da7-4455-9b48-18a274356330 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.231351 Aug 31 19:23:42.886681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 479/994] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:42 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:42.893090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.893090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.893961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.893961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.894965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.895099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.927408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:42.927889 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:42.928326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:42.928796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:42.969384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.977350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.978786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:42.979923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-479824bb-af74-47bd-b9ab-eae00880a635 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1371 microversion: 2.20 time: 0.098759 Aug 31 19:23:42.980472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 516/995] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:42 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:43.907737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:43.908272 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:43.910725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:43.911336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:43.914983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.915474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.916111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.916807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.917264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.917688 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.918312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.918807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.919251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:43.919959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:43.920420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:43.920880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:44.130835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.134118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.140399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7c4d8fed-9522-4941-afb8-cba7e72a1c45 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.236702 Aug 31 19:23:44.142249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 480/996] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:43 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:44.146549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:44.147417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:44.149892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d100276c-55d2-441f-8d43-8402adfe17cc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.243496 Aug 31 19:23:44.150904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 517/997] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:43 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:44.152966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:44.154523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:44.155193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:44.155631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:44.156544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:44.157031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:44.157457 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:44.189693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:44.190092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:44.190523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:44.190963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:44.232222 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.240985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.242454 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:44.243600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5034467d-b4f6-47cb-b8a1-38f3f1b07de1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1371 microversion: 2.20 time: 0.100980 Aug 31 19:23:44.244324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 481/998] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:44 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:45.163810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:45.164422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:45.171204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.171692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.172734 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.173272 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:45.173720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.173835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:45.173930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.174268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.179597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.180074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.180498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.181239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.181714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.182135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.385192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.390802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.394215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7522224c-9c50-435c-a9d7-f12741cf12c6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.225703 Aug 31 19:23:45.394794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 482/999] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:45 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:45.400246 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3ceb4145-548c-40a5-97d3-53f4a3e594ea tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.240306 Aug 31 19:23:45.400836 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 518/1000] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:45 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:45.412554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:45.413277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:45.420485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.421019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.421452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.422947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.423597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.424024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.463421 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:45.463904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:45.464338 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:45.464992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:45.506131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.513966 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.515413 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:45.517323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-faf29962-b9d9-4d0f-a6ae-5616dff35c6a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1371 microversion: 2.20 time: 0.111603 Aug 31 19:23:45.517946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 483/1001] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:45 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:46.421579 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:46.422843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:46.423303 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:46.423915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:46.429496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.430128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.430291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.430557 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.430735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.431176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.431291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.431682 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.431883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.432124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.432339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.432793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.624784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:46.637613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-88cf103d-24ff-4478-8203-ad25689239fe tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.219326 Aug 31 19:23:46.639511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 519/1002] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:46 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:46.652064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:46.653441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:46.664263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.664935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.665449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.666558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.666841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.667125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:46.667466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.678438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-41254682-b204-4a7c-af3a-f3addcf0bfb1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1750 microversion: 2.1 time: 0.260604 Aug 31 19:23:46.695251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 484/1003] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:46 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1750 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:46.704374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:46.704977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:46.705491 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:46.706013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:46.751746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:46.760386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:46.761792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:46.762959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-02d1f83f-90f8-47d3-90c1-5c3891aa1984 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 200 len: 1371 microversion: 2.20 time: 0.122224 Aug 31 19:23:46.763526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 520/1004] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:46 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:47.660843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.661449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.668224 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.668962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.669711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.670567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.671028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.671449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.702247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.703532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.710270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.710991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.711428 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.712121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.712766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.713199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.895482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:47.904074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8682eada-c580-4b14-bc58-d4a8520a3844 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.248329 Aug 31 19:23:47.904656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 485/1005] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:47 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:47.909604 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.910201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:47.912267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:47.916021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.916554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.917196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.917896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:47.918343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:47.918760 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:47.921034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ce9f1859-a943-4717-92a6-dafdc10df586 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.222694 Aug 31 19:23:47.921834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 521/1006] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:47 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:47.933190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] HTTP exception thrown: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Request method failure captured: Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 HTTP/1.1 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PYLfV9bWCXA0eLQBiX-k2f1F3xgSoGWKl_avym-zAeJwFoiKkK8W10-Enc-fbX4UDhA1ue7uRoBsmA5MSCe033lCM71T-0OxhLhxBYTrsYlDus-jbhzGPHAT7MAarvCLEQ-J7txA9ygqCcZgUsgd3LdO3Z3GyqTSUERE4u96oLZXo Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:23:47.934972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 25c3f0a2e1fd4067b1804ef42faa46d5 Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:23:47.936775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276'} Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:47.938211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:23:47.939618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:23:47.941104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Returning 404 to user: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:47.941104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-81674b8c-43c4-4e88-a1f1-3666fe14bf2e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 404 len: 111 microversion: 2.20 time: 0.030753 Aug 31 19:23:47.941104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 486/1007] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:47 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:23:47.946432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-98c85a31-8aba-4fde-add4-f5b3429b5948 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '.version_select at 0x7f975faf95e0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:47.966034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-98c85a31-8aba-4fde-add4-f5b3429b5948 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381430543" status: 204 len: 0 microversion: 2.20 time: 0.023662 Aug 31 19:23:47.966602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 522/1008] 10.222.0.95 () {60 vars in 1259 bytes} [Wed Aug 31 19:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381430543 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:23:48.653861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7d0047d6-6c93-43a2-92c8-8e0070a46f72 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'create', calling method: .version_select at 0x7f976330ad30>, body: {"keypair": {"name": "tempest-keypair-46757239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHtZipzC4kJjQ9Tp8/6XISO5uSSroT3O7OCqs+qHmFPGxHwKkqEOTyc3YJnY5U8DrJmW3IFp5IGv/kLvMtXKIj6nw86IxAHWGGLuQYHv8fmcnVf0UBGgtcli/CM29aeag=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:48.670248 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-7d0047d6-6c93-43a2-92c8-8e0070a46f72 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:23:48.674974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-7d0047d6-6c93-43a2-92c8-8e0070a46f72 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for user 25c3f0a2e1fd4067b1804ef42faa46d5 and project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:23:48.701250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7d0047d6-6c93-43a2-92c8-8e0070a46f72 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.050927 Aug 31 19:23:48.708060 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 487/1009] 10.222.0.95 () {62 vars in 1200 bytes} [Wed Aug 31 19:23:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 19:23:48.716322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:48.717209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:48.724190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.724762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.725179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.725884 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.726310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.726796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.818099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'services' on Instance uuid 6b78af99-475c-4400-a557-0a9687987357 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:48.910201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f77f29d0-afd8-4b1d-9472-4abc8ab67144 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "DELETE /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357/os-volume_attachments/0ce7cdb3-73e5-4235-a580-97dc05515d13" status: 202 len: 0 microversion: 2.1 time: 0.198278 Aug 31 19:23:48.910787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 523/1010] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:23:48 2022] DELETE /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357/os-volume_attachments/0ce7cdb3-73e5-4235-a580-97dc05515d13 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:23:48.927122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:48.927928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:48.934855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.935872 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.936265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.937005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.937806 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.938424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.944593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:48.946009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:48.952387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.953486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.953929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:48.954745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:48.955382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:48.955837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:49.185272 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:49.200119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-65418a43-5ac9-4769-8200-857e8d6cf1b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1734 microversion: 2.1 time: 0.276750 Aug 31 19:23:49.201763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 488/1011] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:48 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:49.227131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:49.248865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f9f5c2b1-aef5-46ff-a16f-617c753fd019 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.308321 Aug 31 19:23:49.249451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 524/1012] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:48 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:50.094036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1303405499", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1737780-76b7-4e42-889e-c8e6f7b5ceb1"}], "security_groups": [{"name": "tempest-securitygroup--1996210375"}], "key_name": "tempest-keypair-46757239", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:50.213395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] validate_networks() for [('d1737780-76b7-4e42-889e-c8e6f7b5ceb1', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:23:50.223561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:50.224382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:50.231057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.231544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.231982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.232722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.233210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.233647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.430148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:50.441112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f9df3997-c021-4846-a6ea-36deba322aea tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1714 microversion: 2.1 time: 0.221576 Aug 31 19:23:50.441704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 525/1013] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:50 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1714 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:50.446264 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:50.446859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:50.454630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.454630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.454630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.455237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.455685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.456106 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.738365 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:50.747817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ecc51532-b76d-4dbc-a3fe-014085e8a9c6 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.305081 Aug 31 19:23:50.749252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 526/1014] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:50 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:50.753936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:50.754514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:50.771837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.772630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.773114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.774101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.774457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.774961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.777150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:23:50.777820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:23:50.778389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:23:50.778984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:23:50.779621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:23:50.791666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.792144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.792641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.793376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.793829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.794254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.816640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:23:50.822314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Getting quotas for user 25c3f0a2e1fd4067b1804ef42faa46d5 and project 4adeb4ab309d44a6b3440df802f5bb25. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:23:50.837367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:23:50.839699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:23:50.871985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 while it is in vm_state rescued Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Request method failure captured: Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments/79abc7ba-c581-42eb-a548-332b67afa387 HTTP/1.1 Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PeVr-VH7V6H-jdY3ceG7PwqENqKNvCM8u4JaVcyvyGnstm48zEmYLv80PCi8p3GbTd5yBYWIeNZfxczjK__7hbOaO72FX4-dm6B09eskqpUkjGsmWBTSX_VPgolDJVn79VVcGnGfMXphvUiyFakP990ImyMlyTAwjRfrjtQKMu3qY Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:23:50.873807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: fd0f7f51482040d7a89df3f7502c2638 Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:23:50.875481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Cannot 'detach_volume' instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 while it is in vm_state rescued Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'server_id': '6d389fb4-28b6-4d7e-80bc-fb896c5bf004', 'id': '79abc7ba-c581-42eb-a548-332b67afa387'} Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:23:50.876183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 while it is in vm_state rescued Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 while it is in vm_state rescued Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:23:50.877784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Returning 409 to user: Cannot 'detach_volume' instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 while it is in vm_state rescued {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:23:50.878887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-703e1459-ceaf-4052-b0f3-5f99d1fcc55b tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments/79abc7ba-c581-42eb-a548-332b67afa387" status: 409 len: 152 microversion: 2.1 time: 0.125505 Aug 31 19:23:50.878887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 527/1015] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:23:50 2022] DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments/79abc7ba-c581-42eb-a548-332b67afa387 => generated 152 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:23:50.885081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:50.885616 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:50.891813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.892300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.892778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.893474 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:50.893930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:50.894357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:50.897461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e64762af-bb29-44c6-acfc-4843098e9d71 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.807722 Aug 31 19:23:50.898445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 489/1016] 10.222.0.95 () {62 vars in 1188 bytes} [Wed Aug 31 19:23:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 19:23:50.910219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1fd5e2cb-c914-434c-9295-ad958c1d8a29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:50.910815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1fd5e2cb-c914-434c-9295-ad958c1d8a29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:50.953941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:50.978098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1fd5e2cb-c914-434c-9295-ad958c1d8a29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:50.985458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b2312700-18b4-458b-b6b1-1dbd5c97aaa7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "POST /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/action" status: 202 len: 0 microversion: 2.1 time: 0.103140 Aug 31 19:23:50.986024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 528/1017] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:23:50 2022] POST /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:23:50.989236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1fd5e2cb-c914-434c-9295-ad958c1d8a29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:50.990690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1fd5e2cb-c914-434c-9295-ad958c1d8a29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:50.991989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1fd5e2cb-c914-434c-9295-ad958c1d8a29 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1280 microversion: 2.20 time: 0.086682 Aug 31 19:23:50.993066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 490/1018] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:50 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:51.007508 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:51.008353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:51.018015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.018630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.021099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.022231 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.022760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.023219 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.129719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:51.130470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:51.137694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.138220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.138846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.139733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.140421 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.141122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.176095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:23:51.244354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:51.254459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-70b4bdf7-7434-4868-9be9-2e59896d4fa4 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1722 microversion: 2.1 time: 0.264010 Aug 31 19:23:51.255600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 529/1019] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:50 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:51.319950 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3d7ddce5-6b33-46f2-8eb3-9e4afe6dad60 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "DELETE /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 204 len: 0 microversion: 2.1 time: 0.195389 Aug 31 19:23:51.324654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 491/1020] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:23:51 2022] DELETE /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:23:51.330275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:51.330890 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:51.337226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.337805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.338500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.339207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.339822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.340410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.484033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:51.492241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-690a9951-46e8-4610-a140-a50e10adc583 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1513 microversion: 2.1 time: 0.165795 Aug 31 19:23:51.492785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 530/1021] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:51 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:51.777560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:51.778157 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:51.785594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.786063 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.786490 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.787166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:51.787610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:51.788025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:51.943313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:51.954822 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fda2a280-91a7-4082-9118-3fe6a4b05664 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.181493 Aug 31 19:23:51.955391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 492/1022] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:51 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:52.013512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:52.014132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:52.020856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.021345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.021787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.022485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.022939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.023372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.084086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:52.092190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:52.094254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:52.095362 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e6b83d53-b931-4760-bbd5-26ee2bf3839f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1284 microversion: 2.20 time: 0.085750 Aug 31 19:23:52.095906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 531/1023] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:52 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:52.276275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:52.277062 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:52.283677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.284418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.284886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.285856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.286317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.286742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.415069 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:52.424203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a1eda36c-1030-4a45-a4ff-30d6c397ed7d tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1722 microversion: 2.1 time: 0.151853 Aug 31 19:23:52.424800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 493/1024] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:52 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:52.514067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:52.514676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:52.521425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.521914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.522349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.523039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.523493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.523917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.657979 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:52.665970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-866cacc0-e87e-4bbd-84e8-76604175dd4c tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1513 microversion: 2.1 time: 0.155772 Aug 31 19:23:52.666526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 532/1025] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:52 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:52.975993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:52.976602 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:52.982571 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.983035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.983459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:52.984193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:52.984696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:52.985110 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.117520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:53.118130 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:53.124191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:53.125376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:53.126162 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.126533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:53.127460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:53.127460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.129900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:53.137933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bb42f663-c35e-4c0b-a918-d1f3922ca358 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.165823 Aug 31 19:23:53.138690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 494/1026] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:52 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:53.188816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:53.197005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:53.198458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:53.199558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8821ae13-5a19-46c2-b925-af54e77a73a6 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1284 microversion: 2.20 time: 0.085967 Aug 31 19:23:53.200107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 533/1027] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:53 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:53.446164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:53.446719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:53.452708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:53.453226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:53.453751 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.454436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:53.454883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:53.455299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.587616 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:53.596641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2199adb-cd85-4298-9e20-db59f66d4ac5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1722 microversion: 2.1 time: 0.154474 Aug 31 19:23:53.597201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 495/1028] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:53 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:53.691739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:53.692335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:53.698760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:53.699179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:53.699615 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.700296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:53.700774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:53.701190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:53.836858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:53.845157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e606c2c8-b523-4341-acf7-8155ef46cd88 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1513 microversion: 2.1 time: 0.157819 Aug 31 19:23:53.845718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 534/1029] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:53 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:54.163090 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:54.163702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:54.172956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.173444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.174051 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.174578 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.175091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.175475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.223452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:54.224068 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:54.230357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.230843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.231286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.232667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.232667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.232905 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.314503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:54.323144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:54.324629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:54.325766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0e3431d0-4a4c-4ab1-af32-52924f99f18b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1284 microversion: 2.20 time: 0.107138 Aug 31 19:23:54.326533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 535/1030] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:54 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:23:54.355999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:54.360731 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:54.367127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ca5653ec-64fa-4229-93bc-b1b71ddda9c4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.211065 Aug 31 19:23:54.367716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 496/1031] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:54 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:54.618777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:54.620191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:54.626935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.627420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.627850 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.628551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.629029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.629451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.777811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:54.787368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-65a7105c-122f-4269-9629-d2bed858f375 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1722 microversion: 2.1 time: 0.172491 Aug 31 19:23:54.787957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 536/1032] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:54 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:54.867279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:54.868558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:54.877061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.877555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.877994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:54.878705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:54.879288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:54.879981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.031756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:55.040031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b50b848a-7baa-4fde-948f-3ffd8ec9b8e3 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1513 microversion: 2.1 time: 0.177681 Aug 31 19:23:55.052831 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 497/1033] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:54 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:55.154772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-29ddee15-2f23-462f-bc1b-f1fd020fabaf req-d87c83b7-1185-4eb5-abab-70a64ba2a494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b78af99-475c-4400-a557-0a9687987357", "name": "network-vif-deleted", "tag": "33ea59b2-756f-464d-a33a-7fb9bee153e1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:55.166170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-29ddee15-2f23-462f-bc1b-f1fd020fabaf req-d87c83b7-1185-4eb5-abab-70a64ba2a494 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.166688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-29ddee15-2f23-462f-bc1b-f1fd020fabaf req-d87c83b7-1185-4eb5-abab-70a64ba2a494 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.167124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-29ddee15-2f23-462f-bc1b-f1fd020fabaf req-d87c83b7-1185-4eb5-abab-70a64ba2a494 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.179503 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-29ddee15-2f23-462f-bc1b-f1fd020fabaf req-d87c83b7-1185-4eb5-abab-70a64ba2a494 service nova] Creating event network-vif-deleted:33ea59b2-756f-464d-a33a-7fb9bee153e1 for instance 6b78af99-475c-4400-a557-0a9687987357 on hv-cinder-85221 Aug 31 19:23:55.184810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-29ddee15-2f23-462f-bc1b-f1fd020fabaf req-d87c83b7-1185-4eb5-abab-70a64ba2a494 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033840 Aug 31 19:23:55.185403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 537/1034] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:55.349074 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:55.349675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:55.355603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.356080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.356507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.357227 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.357679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.358099 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.390778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:55.391652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:55.397927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.398416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.398862 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.399566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.400021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.400450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.421548 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:55.429465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:55.430898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:55.431984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e2cbfe06-fe98-4d68-9bde-1fc067fb03a3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1332 microversion: 2.20 time: 0.086924 Aug 31 19:23:55.432539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 498/1035] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:55 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:55.549112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:55.558167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9eaeca60-1b32-4dc7-b397-fac2d3a0632b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.171742 Aug 31 19:23:55.558730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 538/1036] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:55 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:55.809090 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:55.809703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:55.815826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.816377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.816834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.817533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:55.817989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:55.818419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:55.951614 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:55.960330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-df44eb36-d770-49f1-97ba-38c89f3d9099 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1722 microversion: 2.1 time: 0.155288 Aug 31 19:23:55.960912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 499/1037] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:55 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:56.062519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:56.063094 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:56.066464 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:56.070565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.071041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.071472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.072161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.072633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.073055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.142318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:56.150120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a5deeeb1-b050-4a2a-b6a5-39357f96703f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1304 microversion: 2.1 time: 0.092053 Aug 31 19:23:56.150690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 539/1038] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:56 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:56.458866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:56.459426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:56.465904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.466380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.466809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.467492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.467941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.468418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.531661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:56.540013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:56.541543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:56.542662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e4e9763a-c40e-4bf5-b2d4-2110b079e085 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1332 microversion: 2.20 time: 0.087780 Aug 31 19:23:56.543204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 500/1039] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:56 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:56.579698 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:56.580340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:56.586511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.587029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.587468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.588456 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.588999 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.589735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.736236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:56.745204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ca58dff7-94b7-4fe0-b9af-7e6311d02068 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.169411 Aug 31 19:23:56.745791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 540/1040] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:56 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:56.983055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:56.983713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:56.990022 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.990509 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.990944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:56.991674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:56.992138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:56.992777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.124402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:57.133625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-25f1241d-c0a8-4823-b905-b5ad9bd6eabd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1722 microversion: 2.1 time: 0.154835 Aug 31 19:23:57.134191 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 501/1041] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:56 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:57.170564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:57.171237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:57.178142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:57.178625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:57.179071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.179770 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:57.180226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:57.180840 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.243012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:57.251124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8fc1d04a-7f74-49e9-afe4-9921d07cd55d tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1304 microversion: 2.1 time: 0.084402 Aug 31 19:23:57.251737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 541/1042] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:57 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:57.566159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:57.566764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:57.573459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:57.573939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:57.574364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.575050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:57.575497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:57.575908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.642902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:57.651029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:57.653314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:57.654485 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-eb4989c7-4326-487d-9619-1dd03aec5947 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1340 microversion: 2.20 time: 0.092746 Aug 31 19:23:57.655058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 502/1043] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:57 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:57.768102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:57.768650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:57.775442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:57.776021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:57.776524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.777300 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:57.777813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:57.778257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:57.925714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:57.934330 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-729eeef1-0346-4cb8-b78d-29e3256dfcc1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.170475 Aug 31 19:23:57.934902 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 542/1044] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:57 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:58.157484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:58.159070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:58.166742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.167347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.167852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.168661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.169201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.170000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.273226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:58.273867 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:58.279916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.280405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.280940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.281652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.282103 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.282529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.306026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:58.315556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f6c7659f-8475-4c5d-bc37-da5fc5337408 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1728 microversion: 2.1 time: 0.162515 Aug 31 19:23:58.316138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 503/1045] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:58 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:58.317700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.318183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.318619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.319072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'fault' on Instance uuid 6b78af99-475c-4400-a557-0a9687987357 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:58.337386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:58.338007 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:58.351326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.351809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.352246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.352997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.353583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.354006 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.364883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:58.373284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7b181826-7c0a-4bb1-922b-037b4e56ffd0 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1309 microversion: 2.1 time: 0.104530 Aug 31 19:23:58.374120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 543/1046] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:58 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:23:58.438079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6f8e0c8e-7036-42c3-bce0-a47ec672ecd7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104439 Aug 31 19:23:58.438656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 504/1047] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:23:58 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:23:58.678988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:58.679592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:58.685603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.686017 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.686445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.687163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.687606 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.688026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.764700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:58.774239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:58.775721 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:58.776877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b2aab5ca-1211-4c20-a401-16b0fdc2241d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1350 microversion: 2.20 time: 0.101858 Aug 31 19:23:58.777605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 544/1048] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:58 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:58.956514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:58.957177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:58.963426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.963905 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.964352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:58.965070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:58.965521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:58.965931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.248937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:59.257650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-25f75594-37bc-44fd-a784-349c4cfe093e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.305501 Aug 31 19:23:59.258277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 505/1049] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:58 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:59.397398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:59.398294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:59.406396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:59.407180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:59.407742 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.408479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:59.410989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:59.410989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.431050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:59.448995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:59.449487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:59.449928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.450385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lazy-loading 'fault' on Instance uuid 6b78af99-475c-4400-a557-0a9687987357 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:23:59.675392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e04230bb5b34b27aad5c2a46230a5cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b530b6cef6943ee93e561b05d1f846d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:23:59.683459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-83bfc2ac-148b-4bf0-a6ce-70d45070c23f tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 200 len: 1309 microversion: 2.1 time: 0.290623 Aug 31 19:23:59.684045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 545/1050] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:23:59 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 1309 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:23:59.803286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:59.803903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:23:59.821230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:59.821706 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:59.822152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.822866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:59.823344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:59.823776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.881778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-7e606f4d-5cdf-48dc-947a-d038fc25e725 req-377537db-70d0-4d3f-a9ab-8a523d6990e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d389fb4-28b6-4d7e-80bc-fb896c5bf004", "tag": "1a01f436-a378-4dc6-a024-41f23bb205d1"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:23:59.900297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7e606f4d-5cdf-48dc-947a-d038fc25e725 req-377537db-70d0-4d3f-a9ab-8a523d6990e1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:59.902065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7e606f4d-5cdf-48dc-947a-d038fc25e725 req-377537db-70d0-4d3f-a9ab-8a523d6990e1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:59.907892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-7e606f4d-5cdf-48dc-947a-d038fc25e725 req-377537db-70d0-4d3f-a9ab-8a523d6990e1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:59.936528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-7e606f4d-5cdf-48dc-947a-d038fc25e725 req-377537db-70d0-4d3f-a9ab-8a523d6990e1 service nova] Creating event network-changed:1a01f436-a378-4dc6-a024-41f23bb205d1 for instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 on hv-cinder-85221 Aug 31 19:23:59.943748 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-7e606f4d-5cdf-48dc-947a-d038fc25e725 req-377537db-70d0-4d3f-a9ab-8a523d6990e1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163381 Aug 31 19:23:59.945460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 506/1051] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:00.016775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:00.026037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:00.027855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:00.029211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-de0bad99-c6ee-4280-9482-f2208fdcdb5f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.229816 Aug 31 19:24:00.030288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 546/1052] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:23:59 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:00.279993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:00.280650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:00.287596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:00.288073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:00.288514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:00.289239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:00.289686 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:00.290104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:00.443488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:00.452214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5991e91e-e708-465d-8269-4e19bb8ca605 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.176487 Aug 31 19:24:00.453998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 507/1053] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:00 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:00.707741 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:00.708670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] [instance: 6b78af99-475c-4400-a557-0a9687987357] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:00.716238 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:00.716994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:00.717430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:00.718758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:00.719182 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:00.719772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:00.737786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] HTTP exception thrown: Instance 6b78af99-475c-4400-a557-0a9687987357 could not be found. Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Request method failure captured: Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 HTTP/1.1 Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7Sp8vKFePOBmoPq7azCiLkLYHQ8eDFh8eWnMZQeu1SUZjNJAJzPFmuyfFxwTC_-rTkFtIZPyOEr1wIE69_RPr7pf1kLItJ12eAHhcN-OlTAO3mdeZtu0C5d8Sy2p9Axhv-ldU4pkGTVdtua2qNIFwhQ2moBI_ttMEyQc7Umi7_Oxtg Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 3b530b6cef6943ee93e561b05d1f846d Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1988652071 Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:24:00.740064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/3b530b6cef6943ee93e561b05d1f846d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesSnapshotTestJSON-1988652071 Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 3b530b6cef6943ee93e561b05d1f846d Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1988652071 Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesSnapshotTestJSON-1988652071-project Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 1e04230bb5b34b27aad5c2a46230a5cc Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesSnapshotTestJSON-1988652071-project Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 6b78af99-475c-4400-a557-0a9687987357 could not be found. Aug 31 19:24:00.741924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '6b78af99-475c-4400-a557-0a9687987357'} Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b78af99-475c-4400-a557-0a9687987357 could not be found. Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:24:00.742707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b78af99-475c-4400-a557-0a9687987357 could not be found. Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b78af99-475c-4400-a557-0a9687987357 could not be found. Aug 31 19:24:00.744011 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:00.747809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] Returning 404 to user: Instance 6b78af99-475c-4400-a557-0a9687987357 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:24:00.747809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4e2e9d0f-2334-4a9f-a36c-73068369aba5 tempest-VolumesSnapshotTestJSON-1988652071 tempest-VolumesSnapshotTestJSON-1988652071-project] 10.222.0.95 "GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357" status: 404 len: 111 microversion: 2.1 time: 0.040422 Aug 31 19:24:00.747809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 547/1054] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:00 2022] GET /compute/v2.1/servers/6b78af99-475c-4400-a557-0a9687987357 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:24:01.055836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:01.056740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:01.059502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:01.060169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=12 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:01.095138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:01.095784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:01.096150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:01.097317 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:01.097845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:01.098274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:01.272104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:01.281480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:01.282942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:01.284328 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7c13e57b-4d6a-4fca-ae58-5378c3355d66 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.234211 Aug 31 19:24:01.284927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 508/1055] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:01 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:01.474997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:01.475597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:01.481803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:01.482302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:01.483125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:01.484442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:01.484928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:01.485351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:01.651702 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:01.662866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-1ad09dcf-efee-44b6-816d-999095c734b8 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.191581 Aug 31 19:24:01.663745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 548/1056] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:01 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:01.760746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-1aa6549d-e0f3-45b8-9a59-bddbf9754e63 req-a3b9c639-0ddf-4722-8e7f-f4a1ae766cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:01.771834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-1aa6549d-e0f3-45b8-9a59-bddbf9754e63 req-a3b9c639-0ddf-4722-8e7f-f4a1ae766cd1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:01.772754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-1aa6549d-e0f3-45b8-9a59-bddbf9754e63 req-a3b9c639-0ddf-4722-8e7f-f4a1ae766cd1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:01.773196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-1aa6549d-e0f3-45b8-9a59-bddbf9754e63 req-a3b9c639-0ddf-4722-8e7f-f4a1ae766cd1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:01.787515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-1aa6549d-e0f3-45b8-9a59-bddbf9754e63 req-a3b9c639-0ddf-4722-8e7f-f4a1ae766cd1 service nova] Creating event network-changed:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:24:01.794391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-1aa6549d-e0f3-45b8-9a59-bddbf9754e63 req-a3b9c639-0ddf-4722-8e7f-f4a1ae766cd1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037246 Aug 31 19:24:01.795178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 509/1057] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:01.961210 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-a132d085-940a-4360-943b-6c202f3a0053 req-e4c5cedd-201e-4654-abf5-b09ae2ea0633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d389fb4-28b6-4d7e-80bc-fb896c5bf004", "tag": "1a01f436-a378-4dc6-a024-41f23bb205d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:01.972683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a132d085-940a-4360-943b-6c202f3a0053 req-e4c5cedd-201e-4654-abf5-b09ae2ea0633 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:01.973170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a132d085-940a-4360-943b-6c202f3a0053 req-e4c5cedd-201e-4654-abf5-b09ae2ea0633 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:01.973584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-a132d085-940a-4360-943b-6c202f3a0053 req-e4c5cedd-201e-4654-abf5-b09ae2ea0633 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:01.987584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-a132d085-940a-4360-943b-6c202f3a0053 req-e4c5cedd-201e-4654-abf5-b09ae2ea0633 service nova] Creating event network-changed:1a01f436-a378-4dc6-a024-41f23bb205d1 for instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 on hv-cinder-85221 Aug 31 19:24:01.992949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-a132d085-940a-4360-943b-6c202f3a0053 req-e4c5cedd-201e-4654-abf5-b09ae2ea0633 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035404 Aug 31 19:24:01.993670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 549/1058] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:02.308655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:02.309246 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:02.316373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:02.316951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:02.317425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:02.318149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:02.318603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:02.318996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:02.484390 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:02.493038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:02.494706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:02.495615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-62e17f9b-a3ab-43e3-bf88-51cd112360c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.191650 Aug 31 19:24:02.496181 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 510/1059] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:02 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:02.686280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:02.687443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:02.694263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:02.694841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:02.695345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:02.696116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:02.696668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:02.697342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:02.849737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:02.858284 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c8801c28-9531-49ce-9487-fbe3f38ce15d tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.176671 Aug 31 19:24:02.860669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 550/1060] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:02 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:03.518935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:03.519585 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:03.525871 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:03.526341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:03.526767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:03.527465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:03.527893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:03.528311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:03.664920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:03.673904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:03.675380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:03.676641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-76ce7bdb-33d1-4154-a034-0b50e20e4630 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.161555 Aug 31 19:24:03.677212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 511/1061] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:03 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:03.881375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:03.881924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:03.888656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:03.889161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:03.889596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:03.890920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:03.891575 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:03.892003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:04.043696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:04.051880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-18a1878c-af1a-41ba-9009-46a1638b3b29 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.174590 Aug 31 19:24:04.052482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 551/1062] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:03 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:04.700380 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:04.700984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:04.703750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:04.709511 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:04.709998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:04.710482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:04.711184 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:04.711640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:04.712065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:04.857846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:04.867766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:04.869410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:04.870526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-058d255f-28eb-451b-bd9a-49dcb92c40b1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.175021 Aug 31 19:24:04.871572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 512/1063] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:04 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:05.073562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:05.074185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:05.081387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:05.081860 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:05.082292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:05.082987 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:05.083436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:05.083854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:05.231788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:05.240554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e49de4b0-0a00-416f-8ee4-354c89c78d6e tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.170796 Aug 31 19:24:05.241193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 552/1064] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:05 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:05.895001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:05.895608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:05.901854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:05.902362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:05.902796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:05.903502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:05.903954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:05.904378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.043400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:06.053029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:06.054521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:06.055746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-33a6187e-e3bb-4b56-a828-622d669fee39 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.164988 Aug 31 19:24:06.056484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 513/1065] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:05 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:24:06.263996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:06.264772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:06.272435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.273191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.273706 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.274426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.274901 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.275521 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.336833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:06.339567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:06.348586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.349411 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.350195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.351401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.352159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.353207 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.404869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0bce8fde-26dd-4802-94f2-96b757e62883 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073099 Aug 31 19:24:06.405549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 514/1066] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:24:06 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:24:06.426441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:06.434937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-95711f7a-6ae0-40fc-b5b6-cb2a3c6188de tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.175717 Aug 31 19:24:06.435514 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 553/1067] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:06 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:06.479368 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:06.480024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:06.486958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.487433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.487829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.488622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.489112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.489522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.493897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=100 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:06.517759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:24:06.603335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-449d92e8-2d4b-4e62-ae78-daba0f77af73 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 204 len: 0 microversion: 2.1 time: 0.128989 Aug 31 19:24:06.603942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 515/1068] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:24:06 2022] DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:24:06.614398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:06.615250 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:06.623317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.623518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.624681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.625584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:06.626307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:06.626952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:06.769209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:06.779691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-228f347c-ae37-4976-b0de-810fa060503f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.170700 Aug 31 19:24:06.781584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 554/1069] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:06 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:07.080285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:07.080931 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:07.086882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:07.087533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:07.087972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:07.088873 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:07.089338 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:07.089763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:07.226067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:07.234250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:07.235698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:07.236926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ba0d214f-ff12-43e0-8b14-9cd13811a2b7 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.161062 Aug 31 19:24:07.237501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 516/1070] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:07 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:07.457682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:07.458223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:07.465179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:07.465665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:07.466104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:07.466804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:07.467257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:07.467683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:07.616264 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:07.625544 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d6e2ce0c-d674-4aee-bbd9-c4eab5a9db4f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.171044 Aug 31 19:24:07.626262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 555/1071] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:07 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:07.803017 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:07.803709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:07.809888 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:07.810367 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:07.810794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:07.811506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:07.811951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:07.812365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:07.951756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:07.960432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e9bcadfb-e968-4ddf-91cd-5285faed7cf1 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.161227 Aug 31 19:24:07.961017 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 517/1072] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:07 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:08.260029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:08.260714 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:08.267539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:08.268020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:08.268455 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:08.269190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:08.269645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:08.270069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:08.402960 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:08.413605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:08.415332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:08.416436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-55755785-d79c-4002-92a1-d2c2f6a7d661 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.160420 Aug 31 19:24:08.417066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 556/1073] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:08 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:08.647734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:08.648435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:08.654658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:08.655267 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:08.656392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:08.657272 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:08.657722 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:08.658161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:08.814131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:08.822259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c6b17554-2eea-4a1d-a295-9502b7f33b9b tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.178713 Aug 31 19:24:08.822830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 518/1074] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:08 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:08.983609 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:08.984200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:08.990809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:08.991287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:08.991719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:08.992408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:08.992899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:08.993320 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:09.133524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:09.142173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7c1ac27b-6c47-44f6-a7dd-bb81ba6eb705 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.162606 Aug 31 19:24:09.144614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 557/1075] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:08 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:09.438949 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:09.439546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:09.445665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:09.446141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:09.446572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:09.447252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:09.447698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:09.448110 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:09.590401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:09.599403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:09.601037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:09.602163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aa346617-a30b-4042-8eba-7995785315be tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.167187 Aug 31 19:24:09.602714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 519/1076] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:09 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:09.844218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:09.844855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:09.851052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:09.851534 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:09.851974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:09.852719 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:09.853173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:09.853599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:10.012398 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:10.021431 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e2ef6300-4a7c-4e14-ac4f-4c6c7547437f tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1755 microversion: 2.1 time: 0.181329 Aug 31 19:24:10.022087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 558/1077] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:09 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:24:10.163590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:10.164194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:10.170479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:10.171519 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:10.172200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:10.172944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:10.173398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:10.173818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:10.312762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:10.320752 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3e6d841c-7d14-4f05-ac11-8f018b994618 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.160885 Aug 31 19:24:10.321333 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 520/1078] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:10 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:10.626526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:10.627651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:10.636376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:10.636943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:10.637434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:10.638083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:10.638554 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:10.639029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:10.789465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:10.798904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:10.800363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:10.801512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-63915b3d-d35e-4965-8b92-07aec00ff98a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.180658 Aug 31 19:24:10.802078 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 559/1079] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:10 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:11.044386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:11.045007 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:11.051584 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:11.052055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:11.052486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:11.053190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:11.053633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:11.054048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:11.203000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:11.211449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54df57fb-17d9-4095-b7aa-d6b6e2d010bd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1758 microversion: 2.1 time: 0.170786 Aug 31 19:24:11.212019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 521/1080] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:11 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:11.341488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:11.342047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:11.349277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:11.349762 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:11.350200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:11.350895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:11.351342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:11.351766 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:11.482422 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:11.490478 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-2670eb7b-6e05-482f-be55-cf84fa33cffd tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.152907 Aug 31 19:24:11.491043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 560/1081] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:11 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:11.825425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:11.826023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:11.832326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:11.832843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:11.833300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:11.833962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:11.834412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:11.834833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:11.982251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:11.992036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:11.993672 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:11.994778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c49389f4-b62e-436f-ac4d-497489a0dd44 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.173270 Aug 31 19:24:11.995335 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 522/1082] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:11 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:12.511517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:12.512094 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:12.518706 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:12.519180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:12.519618 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:12.520307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:12.520796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:12.521220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:12.652172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:12.661939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a32c6881-d643-4148-b36c-f405a8adca58 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.154358 Aug 31 19:24:12.662527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 561/1083] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:12 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:13.018250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:13.018861 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:13.025174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:13.025658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:13.026092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:13.026832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:13.027279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:13.027706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:13.169583 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:13.177879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:13.179322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:13.180621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0c42e6e0-e356-4950-a0f0-79afa42e15e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.166832 Aug 31 19:24:13.181182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 523/1084] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:13 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:13.684502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:13.685181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:13.692813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:13.693347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:13.693861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:13.694493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:13.694952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:13.695381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:13.831463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:13.839136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-86341de4-e2f9-43f0-b5df-d3f8126ea018 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.159470 Aug 31 19:24:13.839752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 562/1085] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:13 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:14.203961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:14.204673 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:14.210631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.211098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.211521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.212200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.212673 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.213093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.341867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:14.349985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:14.351419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:14.352545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cc1b9abd-7b10-4a54-8cbe-13cffc1e10e4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.153166 Aug 31 19:24:14.353120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 524/1086] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:14 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:14.861937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:14.862481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:14.871288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.871881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.872397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.873217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.873757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.874433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.879364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:15.039535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:15.049016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d1b29682-b411-48b2-945e-455082312a10 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1673 microversion: 2.1 time: 0.191833 Aug 31 19:24:15.049685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 563/1087] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:14 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:15.377701 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:15.379608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:15.386296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:15.386726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:15.387507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:15.388428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:15.389102 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:15.389592 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:15.526336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-dbd90bbd-eb42-4f64-bfe9-c061a2a9973d req-8e495fc5-3e28-47b9-894b-5b797524cbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "name": "network-vif-plugged", "status": "completed", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:15.555031 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-dbd90bbd-eb42-4f64-bfe9-c061a2a9973d req-8e495fc5-3e28-47b9-894b-5b797524cbb0 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:15.555792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-dbd90bbd-eb42-4f64-bfe9-c061a2a9973d req-8e495fc5-3e28-47b9-894b-5b797524cbb0 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:15.556458 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-dbd90bbd-eb42-4f64-bfe9-c061a2a9973d req-8e495fc5-3e28-47b9-894b-5b797524cbb0 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:15.566119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:15.575987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:15.577502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:15.579332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-11b4fddf-ebc0-437b-a4e1-0b781f6e465e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.207489 Aug 31 19:24:15.580376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 525/1088] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:15 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:15.589123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-dbd90bbd-eb42-4f64-bfe9-c061a2a9973d req-8e495fc5-3e28-47b9-894b-5b797524cbb0 service nova] Creating event network-vif-plugged:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:24:15.603421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-dbd90bbd-eb42-4f64-bfe9-c061a2a9973d req-8e495fc5-3e28-47b9-894b-5b797524cbb0 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079904 Aug 31 19:24:15.607191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 564/1089] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:15.786542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-63ec1aa2-e87a-44f9-bc2b-dac86f95788f req-64e79830-ded9-441d-875e-5540fc392d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e955cd6-de98-48e5-90af-020d4952bc40", "name": "network-vif-deleted", "tag": "28578596-0058-4fd6-b56b-d8ccf5626348"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:15.799350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-63ec1aa2-e87a-44f9-bc2b-dac86f95788f req-64e79830-ded9-441d-875e-5540fc392d96 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:15.800114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-63ec1aa2-e87a-44f9-bc2b-dac86f95788f req-64e79830-ded9-441d-875e-5540fc392d96 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:15.800562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-63ec1aa2-e87a-44f9-bc2b-dac86f95788f req-64e79830-ded9-441d-875e-5540fc392d96 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:15.817647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-63ec1aa2-e87a-44f9-bc2b-dac86f95788f req-64e79830-ded9-441d-875e-5540fc392d96 service nova] Creating event network-vif-deleted:28578596-0058-4fd6-b56b-d8ccf5626348 for instance 4e955cd6-de98-48e5-90af-020d4952bc40 on hv-cinder-85221 Aug 31 19:24:15.823348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-63ec1aa2-e87a-44f9-bc2b-dac86f95788f req-64e79830-ded9-441d-875e-5540fc392d96 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041349 Aug 31 19:24:15.823952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 526/1090] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:16.081418 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:16.082829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:16.096923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:16.097191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:16.097691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:16.098432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:16.098899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:16.099332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:16.137333 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:16.137842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:16.138280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:16.138780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'fault' on Instance uuid 4e955cd6-de98-48e5-90af-020d4952bc40 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:24:16.217190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:16.228707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-093e2ebb-8033-4c8e-af1e-d003bf372603 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1327 microversion: 2.1 time: 0.158431 Aug 31 19:24:16.252692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 565/1091] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:16 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1327 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:16.605265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:16.605960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:16.613343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:16.613829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:16.614262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:16.614964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:16.615410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:16.615829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:16.757073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:16.766424 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:16.768141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:16.769299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-24b2416a-120b-4190-bde7-088d48ac7a69 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.168432 Aug 31 19:24:16.769854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 527/1092] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:16 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:17.264325 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:17.265949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:17.272244 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:17.272776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:17.273212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:17.273919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:17.274374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:17.274803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:17.306918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:17.307396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:17.307833 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:17.308278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'fault' on Instance uuid 4e955cd6-de98-48e5-90af-020d4952bc40 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:24:17.350083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:17.357875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f36e333-bbd0-432d-8427-b1fa8a56f324 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1327 microversion: 2.1 time: 0.097589 Aug 31 19:24:17.358990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 566/1093] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:17 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:17.794496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:17.795143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:17.802268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:17.802752 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:17.803214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:17.803932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:17.804379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:17.804839 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:17.939858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:17.950016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:17.951495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:17.952664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d82eca21-03a3-4005-8337-d79ef9cb6c2d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1406 microversion: 2.20 time: 0.162032 Aug 31 19:24:17.953217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 528/1094] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:17 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:18.379100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:18.379661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:18.386062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:18.386535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:18.386968 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:18.387661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:18.388112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:18.388532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:18.421741 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:18.422213 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:18.422647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:18.423090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'fault' on Instance uuid 4e955cd6-de98-48e5-90af-020d4952bc40 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:24:18.464027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:18.472772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f3ed9449-54ec-4341-b838-34b565a8e56c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 200 len: 1327 microversion: 2.1 time: 0.097569 Aug 31 19:24:18.473343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 567/1095] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:18 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:18.975627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:18.976234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:18.982953 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:18.983767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:18.984471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:18.985193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:18.985657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:18.986083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:19.129223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:19.137438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:19.138887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:19.140801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1d8e71ba-c6ad-4c23-ab52-6e8c6964ad21 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1598 microversion: 2.20 time: 0.169545 Aug 31 19:24:19.141697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 529/1096] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:24:18 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:19.164743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:19.165286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:19.171425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:19.171900 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:19.172332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:19.173040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:19.173486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:19.173902 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:19.263735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9f9258e5-a8d3-4d59-ae62-91485da69c0f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102812 Aug 31 19:24:19.264408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 568/1097] 10.222.0.95 () {60 vars in 1316 bytes} [Wed Aug 31 19:24:19 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:24:19.494495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:19.495013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:19.501680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:19.502159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:19.502585 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:19.503298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:19.503746 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:19.504164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:19.520096 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] HTTP exception thrown: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Request method failure captured: Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 HTTP/1.1 Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbY-IJlu5VoYN-4dCLdGkHDJ1NZUQPBhqiXn15Aj6j9mmx256MoamKybc0khNyF3YGYz6ATFb8lnReyx0XfrcDHg_f1lMN1-pca-bmFfKZkUFxs6LhEbRWwb9fZShW8UpxLt9OSmZwTbxjSKGyhFsEV1XxgSsbJkCIYuJ7g_eXN_E Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:24:19.521250 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: a288c513afd94adaa9f53f9f65dc9dd8 Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:24:19.522793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '4e955cd6-de98-48e5-90af-020d4952bc40'} Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:24:19.523631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:24:19.524883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:24:19.525977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Returning 404 to user: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:24:19.525977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-391aa6f0-59a8-44d1-ae3a-62f460c6699a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 404 len: 111 microversion: 2.1 time: 0.032534 Aug 31 19:24:19.525977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 530/1098] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:19 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:24:19.532475 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-48d101fd-64dd-4f3d-a983-52fd6be7ceba tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '.version_select at 0x7f975fb64040>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:19.554060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-48d101fd-64dd-4f3d-a983-52fd6be7ceba tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510874253" status: 202 len: 0 microversion: 2.1 time: 0.026008 Aug 31 19:24:19.554865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 569/1099] 10.222.0.95 () {58 vars in 1221 bytes} [Wed Aug 31 19:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510874253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:24:20.274340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1124c98c-011c-4587-9a9e-0245fe545171 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: .version_select at 0x7f976330a3a0>, body: {"keypair": {"name": "tempest-keypair-759537644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy8+9EzQ7c3d08l0jZbtlIXvJP//T7Ibkl5P9pppM9aeFlZdYkv3NOcm0JyP3o4Gx8MqZjGnzj+5aUBipiq7zknEcA12yk0NiKnRVeUQP1Y5BznwHLo6HSCVDHYsR5PJw=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:20.280777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-36478c34-7369-4ec9-84c8-df33219df25b req-578cd396-11b4-4cac-9a0a-4002e0e40fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:20.292125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-36478c34-7369-4ec9-84c8-df33219df25b req-578cd396-11b4-4cac-9a0a-4002e0e40fd4 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:20.292355 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-1124c98c-011c-4587-9a9e-0245fe545171 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:24:20.292632 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-36478c34-7369-4ec9-84c8-df33219df25b req-578cd396-11b4-4cac-9a0a-4002e0e40fd4 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:20.293071 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-36478c34-7369-4ec9-84c8-df33219df25b req-578cd396-11b4-4cac-9a0a-4002e0e40fd4 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:20.297617 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-1124c98c-011c-4587-9a9e-0245fe545171 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for user a288c513afd94adaa9f53f9f65dc9dd8 and project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:24:20.305402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-36478c34-7369-4ec9-84c8-df33219df25b req-578cd396-11b4-4cac-9a0a-4002e0e40fd4 service nova] Creating event network-changed:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:24:20.310796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-36478c34-7369-4ec9-84c8-df33219df25b req-578cd396-11b4-4cac-9a0a-4002e0e40fd4 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033759 Aug 31 19:24:20.311962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 570/1100] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:20.324119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1124c98c-011c-4587-9a9e-0245fe545171 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057141 Aug 31 19:24:20.324882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 531/1101] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:24:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:22.097886 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-58587610", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "435f217b-7ded-4e09-b4e3-095f27bf676c"}], "security_groups": [{"name": "tempest-securitygroup--1765164723"}], "key_name": "tempest-keypair-759537644", "user_data": "}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:22.210622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] validate_networks() for [('435f217b-7ded-4e09-b4e3-095f27bf676c', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:24:22.582190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:24:22.582609 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:24:22.583076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:24:22.583477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:24:22.583880 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:24:22.592869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:22.593545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:22.593972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:22.594690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:22.595161 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:22.595579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:22.612708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:24:22.616596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Getting quotas for user a288c513afd94adaa9f53f9f65dc9dd8 and project 6d1e607dfc7e4b089c7e744f4b1059e8. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:24:22.627946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:24:22.630347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:24:22.678109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8699d769-b9d3-40ff-8b9c-886c3b2c2d18 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586616 Aug 31 19:24:22.678759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 571/1102] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:24:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:24:22.690794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-398139a4-c1e2-41cf-b551-65c4aec5a308 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:22.691395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-398139a4-c1e2-41cf-b551-65c4aec5a308 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:22.747066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-398139a4-c1e2-41cf-b551-65c4aec5a308 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:22.755369 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-398139a4-c1e2-41cf-b551-65c4aec5a308 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1235 microversion: 2.1 time: 0.069593 Aug 31 19:24:22.755909 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 532/1103] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:22 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:23.776704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:23.777324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:23.784125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:23.784629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:23.785147 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:23.785835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:23.786288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:23.786713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:23.855441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:23.863073 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-005964b6-d6a3-47f5-b120-da7ef061bb1f tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1287 microversion: 2.1 time: 0.090829 Aug 31 19:24:23.863647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 572/1104] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:23 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:24.884916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:24.885587 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:24.892312 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:24.892820 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:24.893258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:24.893954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:24.894409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:24.894835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:24.914295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:24.960170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:24.968651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-160c4f3d-ceb6-475a-908e-bfa60d025659 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1293 microversion: 2.1 time: 0.086883 Aug 31 19:24:24.969486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 533/1105] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:24 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:25.992170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:25.993462 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:26.000917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:26.001729 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:26.002249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:26.003109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:26.003796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:26.004430 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:26.182273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:26.191064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-75431d93-8c62-43e4-914e-e39b1e9af651 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.203380 Aug 31 19:24:26.191636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 573/1106] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:25 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:26.260814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-13e2c42c-c120-4926-8fcf-7c68a675b27e req-bdd10691-7c37-4ebe-81af-a4a9f3dbecc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044adca5-daa1-4ff7-b516-0847e618d6c7", "tag": "19b37898-88f3-4cfc-b64d-3ea8beb12ae3"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:26.271179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-13e2c42c-c120-4926-8fcf-7c68a675b27e req-bdd10691-7c37-4ebe-81af-a4a9f3dbecc0 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:26.272725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-13e2c42c-c120-4926-8fcf-7c68a675b27e req-bdd10691-7c37-4ebe-81af-a4a9f3dbecc0 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:26.273196 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-13e2c42c-c120-4926-8fcf-7c68a675b27e req-bdd10691-7c37-4ebe-81af-a4a9f3dbecc0 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:26.288484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-13e2c42c-c120-4926-8fcf-7c68a675b27e req-bdd10691-7c37-4ebe-81af-a4a9f3dbecc0 service nova] Creating event network-changed:19b37898-88f3-4cfc-b64d-3ea8beb12ae3 for instance 044adca5-daa1-4ff7-b516-0847e618d6c7 on hv-cinder-85221 Aug 31 19:24:26.294379 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-13e2c42c-c120-4926-8fcf-7c68a675b27e req-bdd10691-7c37-4ebe-81af-a4a9f3dbecc0 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037544 Aug 31 19:24:26.294981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 534/1107] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:27.215303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:27.215895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:27.218682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:27.224138 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:27.224662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:27.225102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:27.225810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:27.226265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:27.226690 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:27.366511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:27.374684 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ef906896-fe82-4277-a5d7-485a600300b6 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.163213 Aug 31 19:24:27.375264 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 574/1108] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:27 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:28.396606 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:28.397229 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:28.403406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:28.403885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:28.404323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:28.405067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:28.405694 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:28.406122 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:28.557915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:28.566761 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a753dcdb-26da-43b8-b8ac-8dee9d61293e tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.174357 Aug 31 19:24:28.567364 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 535/1109] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:28 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:29.591157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:29.593240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:29.601024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:29.601864 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:29.602531 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:29.603490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:29.604396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:29.605055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:29.768628 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:29.776958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f3568933-46a3-47ac-acc7-c222213b2bb9 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.190212 Aug 31 19:24:29.777467 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 575/1110] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:29 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:30.798202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:30.798884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:30.804976 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:30.805461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:30.805891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:30.806609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:30.807055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:30.807475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:30.944052 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:30.951618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c94a9ce8-52ad-4201-bd30-72e23a02d973 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.157336 Aug 31 19:24:30.952491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 536/1111] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:30 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:31.973637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:31.974265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:31.981148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:31.981631 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:31.982136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:31.982881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:31.983678 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:31.983932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:31.990124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-530c9de2-e208-411d-bf41-175ba437da99 req-9ee9aac1-d460-48e0-be19-610e43360cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044adca5-daa1-4ff7-b516-0847e618d6c7", "name": "network-vif-plugged", "status": "completed", "tag": "19b37898-88f3-4cfc-b64d-3ea8beb12ae3"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:32.001838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-530c9de2-e208-411d-bf41-175ba437da99 req-9ee9aac1-d460-48e0-be19-610e43360cfc service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:32.002327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-530c9de2-e208-411d-bf41-175ba437da99 req-9ee9aac1-d460-48e0-be19-610e43360cfc service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:32.002745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-530c9de2-e208-411d-bf41-175ba437da99 req-9ee9aac1-d460-48e0-be19-610e43360cfc service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:32.017395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-530c9de2-e208-411d-bf41-175ba437da99 req-9ee9aac1-d460-48e0-be19-610e43360cfc service nova] Creating event network-vif-plugged:19b37898-88f3-4cfc-b64d-3ea8beb12ae3 for instance 044adca5-daa1-4ff7-b516-0847e618d6c7 on hv-cinder-85221 Aug 31 19:24:32.024129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-530c9de2-e208-411d-bf41-175ba437da99 req-9ee9aac1-d460-48e0-be19-610e43360cfc service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037794 Aug 31 19:24:32.024778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 537/1112] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:32.127792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:32.138303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d510a06a-e235-4247-8654-18fc59a4430d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.170187 Aug 31 19:24:32.139111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 576/1113] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:31 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:33.158915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:33.162340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:33.163291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:33.169963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:33.170439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:33.173211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:33.173965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:33.174426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:33.174856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:33.314856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:33.325742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5677140c-544f-4702-9386-967e799dc6fa tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.169852 Aug 31 19:24:33.326320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 538/1114] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:33 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:24:34.348209 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:34.348974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:34.351100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:34.351922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:34.361038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:34.361526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:34.362530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:34.363278 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:34.363740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:34.364173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:34.504582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:34.512092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-39a2c284-478d-4578-8f90-73616907b9f4 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1361 microversion: 2.1 time: 0.168122 Aug 31 19:24:34.512668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 577/1115] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:34 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:35.535029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:35.535645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:35.537769 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:35.543081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:35.543564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:35.543993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:35.544709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:35.545161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:35.545589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:35.579970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:35.580509 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:35.587421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:35.587909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:35.588393 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:35.589133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:35.589589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:35.590012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:35.616627 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-db5a56b5-4294-4a55-880d-7a3a043437e4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/ips" status: 200 len: 148 microversion: 2.1 time: 0.040416 Aug 31 19:24:35.617217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 578/1116] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:24:35 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:35.686765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:35.694412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bbc19b6c-c2fc-432c-a91c-8aa9e436747b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1547 microversion: 2.1 time: 0.163996 Aug 31 19:24:35.694979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 539/1117] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:35 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:35.715336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:35.715832 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:35.722745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:35.723452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:35.724105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:35.725327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:35.725447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:35.726070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:35.817726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7d927bc1-576a-44c7-a321-f87d39b6e692 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106366 Aug 31 19:24:35.818452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 579/1118] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:24:35 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:36.976605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e52d706-f364-4822-9a27-40c221d1c345"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:36.979511 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:36.986914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:36.987416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:36.987835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:36.988847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:36.989305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:36.989727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:37.016376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-09b9c857-e314-4409-97be-2af698351334 req-f50b3f81-9c2a-40ed-98bc-8e8b27a4af88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "044adca5-daa1-4ff7-b516-0847e618d6c7", "tag": "19b37898-88f3-4cfc-b64d-3ea8beb12ae3"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:37.030804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-09b9c857-e314-4409-97be-2af698351334 req-f50b3f81-9c2a-40ed-98bc-8e8b27a4af88 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:37.031413 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-09b9c857-e314-4409-97be-2af698351334 req-f50b3f81-9c2a-40ed-98bc-8e8b27a4af88 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:37.031910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-09b9c857-e314-4409-97be-2af698351334 req-f50b3f81-9c2a-40ed-98bc-8e8b27a4af88 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:37.044013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-09b9c857-e314-4409-97be-2af698351334 req-f50b3f81-9c2a-40ed-98bc-8e8b27a4af88 service nova] Creating event network-changed:19b37898-88f3-4cfc-b64d-3ea8beb12ae3 for instance 044adca5-daa1-4ff7-b516-0847e618d6c7 on hv-cinder-85221 Aug 31 19:24:37.050368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-09b9c857-e314-4409-97be-2af698351334 req-f50b3f81-9c2a-40ed-98bc-8e8b27a4af88 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038659 Aug 31 19:24:37.051041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 580/1119] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:37.362282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-434694b7-74cf-48db-91f3-dac4376d66f9 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394145 Aug 31 19:24:37.362897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 540/1120] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:24:36 2022] POST /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:45.971425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e52d706-f364-4822-9a27-40c221d1c345"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:45.973920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:45.980925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:45.981410 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:45.981853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:45.982551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:45.983515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:45.983945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:45.986547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=85 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:46.068426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Invalid volume: volume 8e52d706-f364-4822-9a27-40c221d1c345 is already attached to instances: a74c7954-70b5-4071-a5d4-af844041d3bd Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: POST /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments HTTP/1.1 Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 74 Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:24:46.070184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {"volumeAttachment": {"volumeId": "8e52d706-f364-4822-9a27-40c221d1c345"}} Aug 31 19:24:46.071885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Invalid volume: volume 8e52d706-f364-4822-9a27-40c221d1c345 is already attached to instances: a74c7954-70b5-4071-a5d4-af844041d3bd Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'server_id': 'a74c7954-70b5-4071-a5d4-af844041d3bd', 'body': {'volumeAttachment': {'volumeId': '8e52d706-f364-4822-9a27-40c221d1c345'}}} Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8e52d706-f364-4822-9a27-40c221d1c345 is already attached to instances: a74c7954-70b5-4071-a5d4-af844041d3bd Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.072849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8e52d706-f364-4822-9a27-40c221d1c345 is already attached to instances: a74c7954-70b5-4071-a5d4-af844041d3bd Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:46.074319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8e52d706-f364-4822-9a27-40c221d1c345 is already attached to instances: a74c7954-70b5-4071-a5d4-af844041d3bd Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 400 to user: Invalid volume: volume 8e52d706-f364-4822-9a27-40c221d1c345 is already attached to instances: a74c7954-70b5-4071-a5d4-af844041d3bd {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d788cd3c-b3ce-4a8a-8dce-61570f2a76cd tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105386 Aug 31 19:24:46.075811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 581/1121] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:24:45 2022] POST /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:24:46.140606 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:46.141302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:46.147733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:46.148266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:46.148734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:46.149554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:46.150054 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:46.150477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:46.235852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'services' on Instance uuid a74c7954-70b5-4071-a5d4-af844041d3bd {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:24:46.313652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b468e6d7-28e8-4ab1-9547-659ce2fb3a0b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments/8e52d706-f364-4822-9a27-40c221d1c345" status: 202 len: 0 microversion: 2.1 time: 0.177778 Aug 31 19:24:46.314139 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 541/1122] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:24:46 2022] DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments/8e52d706-f364-4822-9a27-40c221d1c345 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:24:46.323142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:46.325337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:46.332733 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:46.333251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:46.333686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:46.334381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:46.334830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:46.335247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:46.367757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7e28609d-ba7f-4417-ac6f-ec364e450f70 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Aug 31 19:24:46.368306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 582/1123] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:24:46 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:47.381698 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:47.385886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:47.397594 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:47.398392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:47.399271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:47.400244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:47.401023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:47.402892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:47.441795 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-653f1fa5-0792-4bde-b32b-7fdd01596c0a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064706 Aug 31 19:24:47.442361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 542/1124] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:24:47 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:48.456666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:48.459190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:48.466005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.466659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.467126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.468543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.469021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.469438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.504553 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0cb0bbb0-2543-435b-bb05-ffa2bbd6a841 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054140 Aug 31 19:24:48.505160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 583/1125] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:24:48 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:24:48.601144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:48.602251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:48.608798 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.609288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.609728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.610419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.610876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.611297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.636120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:24:48.710695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-222a23df-6e2f-4d26-b69f-56f46bf2fc10 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 204 len: 0 microversion: 2.1 time: 0.113486 Aug 31 19:24:48.711201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 543/1126] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:24:48 2022] DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:24:48.720100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:48.721026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:48.727551 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.728061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.728490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.729212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:48.729658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:48.730074 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:48.876793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:48.884434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f03c5b3-7efa-468a-a3c5-0880656aef64 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1678 microversion: 2.1 time: 0.168902 Aug 31 19:24:48.885039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 584/1127] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:48 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:49.906900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:49.907499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:49.914466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:49.914928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:49.915349 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:49.916025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:49.916464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:49.916910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:50.050809 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:50.058584 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-09bc09bf-823d-45a3-894b-d244b193104a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1678 microversion: 2.1 time: 0.156044 Aug 31 19:24:50.059150 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 544/1128] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:49 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:51.081693 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:51.082453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:51.088621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:51.089109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:51.089549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:51.090247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:51.090702 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:51.091129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:51.223957 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:51.231865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4ad3a746-173e-43de-bc58-a8a0ac2ad2ba tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1678 microversion: 2.1 time: 0.154014 Aug 31 19:24:51.232441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 585/1129] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:51 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:24:52.254395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:52.255005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:52.261652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:52.262134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:52.262572 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:52.263270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:52.263726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:52.264855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:52.399370 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:52.407473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5e7c8203-5b5b-4dc8-9b4e-59c5f6911791 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1678 microversion: 2.1 time: 0.156984 Aug 31 19:24:52.408311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 545/1130] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:52 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:24:52.757726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-270808a2-1962-4268-bff2-ec17f5a35777 req-6985adf9-7e21-4748-a921-c1fbb1ecf28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74c7954-70b5-4071-a5d4-af844041d3bd", "name": "network-vif-deleted", "tag": "7abff4ac-3acb-46f3-8fa0-6b910a3538fa"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:52.771091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-270808a2-1962-4268-bff2-ec17f5a35777 req-6985adf9-7e21-4748-a921-c1fbb1ecf28e service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:52.771569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-270808a2-1962-4268-bff2-ec17f5a35777 req-6985adf9-7e21-4748-a921-c1fbb1ecf28e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:52.772001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-270808a2-1962-4268-bff2-ec17f5a35777 req-6985adf9-7e21-4748-a921-c1fbb1ecf28e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:52.784731 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-270808a2-1962-4268-bff2-ec17f5a35777 req-6985adf9-7e21-4748-a921-c1fbb1ecf28e service nova] Creating event network-vif-deleted:7abff4ac-3acb-46f3-8fa0-6b910a3538fa for instance a74c7954-70b5-4071-a5d4-af844041d3bd on hv-cinder-85221 Aug 31 19:24:52.789784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-270808a2-1962-4268-bff2-ec17f5a35777 req-6985adf9-7e21-4748-a921-c1fbb1ecf28e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035827 Aug 31 19:24:52.790475 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 586/1131] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:53.430807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:53.431416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:53.438670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:53.438670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:53.438670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:53.438670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:53.442491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:53.442491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:53.478637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:53.479117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:53.479542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:53.479984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'fault' on Instance uuid a74c7954-70b5-4071-a5d4-af844041d3bd {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:24:53.527059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:53.536352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-48ed599a-02c1-4865-9475-57f876cd518a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 200 len: 1332 microversion: 2.1 time: 0.109259 Aug 31 19:24:53.536843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 546/1132] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:53 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:54.558712 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:54.559416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:54.566425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:54.566904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:54.567343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:54.568187 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:54.568496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:54.568954 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:54.583092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd HTTP/1.1 Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:24:54.584736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:24:54.586419 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'a74c7954-70b5-4071-a5d4-af844041d3bd'} Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:24:54.587374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:24:54.588950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:24:54.590397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:24:54.590397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f59271e4-dfb6-45c4-b13e-04af4ee41284 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 404 len: 111 microversion: 2.1 time: 0.032218 Aug 31 19:24:54.590397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 587/1133] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:54 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:24:54.595690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b443e715-8dc9-413a-a82e-224ab896a8d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '.version_select at 0x7f976323c5e0>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:54.615866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b443e715-8dc9-413a-a82e-224ab896a8d2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390642389" status: 202 len: 0 microversion: 2.1 time: 0.024023 Aug 31 19:24:54.616441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 547/1134] 10.222.0.95 () {58 vars in 1221 bytes} [Wed Aug 31 19:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390642389 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:24:55.266328 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4341ad71-5d8c-49d5-b071-74ffebfc171e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: .version_select at 0x7f975fbad1f0>, body: {"keypair": {"name": "tempest-keypair-248211101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpdxWzjYFvwY+fb6CdTS0pqqKsmxWzcVi2eIpzewT3+KHZh6utVUw2jKRicyaGE3hBd5RhFAkAGIJCQQhHuUf1w3y3aH4DnOlg4sW7jVRnvY4OldnCZJQUSSgWx1wu0Fw=="}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:55.281533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-4341ad71-5d8c-49d5-b071-74ffebfc171e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:24:55.285645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-4341ad71-5d8c-49d5-b071-74ffebfc171e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'key_pairs'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:24:55.308445 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4341ad71-5d8c-49d5-b071-74ffebfc171e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046874 Aug 31 19:24:55.309135 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 588/1135] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:24:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:56.649529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1546050547", "imageRef": "8645a7a7-3a20-44fc-a5a4-140ce6388504", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65051338-00b4-459c-8f05-d190e2d29e4b"}], "security_groups": [{"name": "tempest-securitygroup--414883208"}], "key_name": "tempest-keypair-248211101", "user_data": "}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:56.755463 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.network.neutron [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] validate_networks() for [('65051338-00b4-459c-8f05-d190e2d29e4b', None, None, None, None, None)] {{(pid=120707) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:24:57.126738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:24:57.127168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image limits 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:24:57.127678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Flavor pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:24:57.128086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Image pref 0:0:0 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:24:57.128496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.virt.hardware [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120707) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:24:57.137596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:57.138080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:57.138521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:57.139886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:57.140343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:57.140799 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:57.147805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:57.162401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:24:57.166603 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Getting quotas for user 6e09978ed8b3490db5f92823768f1d15 and project 1cb8f75600714e23bda1c8886bdb22f1. Resources: {'instances', 'ram', 'cores'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:24:57.177732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Going to run 1 instances... {{(pid=120707) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:24:57.180140 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8645a7a7-3a20-44fc-a5a4-140ce6388504',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120707) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:24:57.229974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-91fced96-e308-4aed-a782-a9022f7f350d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584578 Aug 31 19:24:57.230610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 548/1136] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:24:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:24:57.241709 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d729b1df-c2cd-4b03-b809-8f740f01f522 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:57.242363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d729b1df-c2cd-4b03-b809-8f740f01f522 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:57.255948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:57.309720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d729b1df-c2cd-4b03-b809-8f740f01f522 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:57.316959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d729b1df-c2cd-4b03-b809-8f740f01f522 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1241 microversion: 2.1 time: 0.079255 Aug 31 19:24:57.317530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 589/1137] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:57 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:58.339059 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:58.339674 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:58.347235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:58.347712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:58.348141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:58.348856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:58.349383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:58.349806 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:58.415406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:58.423243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-26f81e76-7b3c-41e4-bf26-0aafd3d9a29e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1293 microversion: 2.1 time: 0.088271 Aug 31 19:24:58.423807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 549/1138] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:58 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:24:59.445136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:59.445767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:24:59.452877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:59.453366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:59.453800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:59.454500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:59.454950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:59.455381 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:59.518371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:24:59.526364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-485244f8-0fee-4956-a9c2-f437a0806775 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1299 microversion: 2.1 time: 0.085037 Aug 31 19:24:59.527076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 590/1139] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:24:59 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:00.548937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.549679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:00.556153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.556660 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.557092 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.557784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.558232 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.558655 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.696864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:00.705245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7c87e133-6aa3-4975-8ed1-7168be8f1dce tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.160636 Aug 31 19:25:00.705762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 550/1140] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:00.798591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-b84309be-0c76-4f43-a072-ec9144f01317 req-99686512-8406-4681-b69f-1f622d3b8515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd38835-5c39-470d-91d3-9bf5b47b2fec", "tag": "a7aeda1c-033f-4630-9e3d-cee6e7a973ff"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:00.809013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b84309be-0c76-4f43-a072-ec9144f01317 req-99686512-8406-4681-b69f-1f622d3b8515 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:00.809634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b84309be-0c76-4f43-a072-ec9144f01317 req-99686512-8406-4681-b69f-1f622d3b8515 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:00.810076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-b84309be-0c76-4f43-a072-ec9144f01317 req-99686512-8406-4681-b69f-1f622d3b8515 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:00.822932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-b84309be-0c76-4f43-a072-ec9144f01317 req-99686512-8406-4681-b69f-1f622d3b8515 service nova] Creating event network-changed:a7aeda1c-033f-4630-9e3d-cee6e7a973ff for instance efd38835-5c39-470d-91d3-9bf5b47b2fec on hv-cinder-85221 Aug 31 19:25:00.828856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-b84309be-0c76-4f43-a072-ec9144f01317 req-99686512-8406-4681-b69f-1f622d3b8515 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034018 Aug 31 19:25:00.829472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 591/1141] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:01.137996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:01.139070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:01.145774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.146365 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.146803 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.147600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.147955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.148375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.238210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'services' on Instance uuid 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:01.318840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-68dca301-9e6a-4a57-bbfc-2dd078b01ad6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments/79abc7ba-c581-42eb-a548-332b67afa387" status: 202 len: 0 microversion: 2.1 time: 0.184575 Aug 31 19:25:01.319658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 551/1142] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:25:01 2022] DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments/79abc7ba-c581-42eb-a548-332b67afa387 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:01.329013 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:01.331483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:01.338673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.339277 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.339952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.340887 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.341498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.342546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.375755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-da91cfad-632d-43b1-bfb2-2c26b2f83e95 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051400 Aug 31 19:25:01.376332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 592/1143] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:01 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:01.726844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:01.727550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:01.734586 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.735065 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.735503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.736199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:01.736672 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:01.737094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:01.876599 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:01.884231 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e2eb6244-17cf-4aca-8426-2b664daa37c7 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.162024 Aug 31 19:25:01.884858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 552/1144] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:01 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:02.389740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:02.392104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:02.398976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:02.399484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:02.399898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:02.400629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:02.401186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:02.401604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:02.434416 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d38e2b95-a25f-4914-914a-263f6e1a83e7 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049443 Aug 31 19:25:02.435004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 593/1145] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:02 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:02.906061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:02.906755 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:02.913528 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:02.914026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:02.914452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:02.915275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:02.915750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:02.916190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:03.063002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:03.071507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-676f2fcc-4995-4640-b6c2-08351bc9f1ae tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.169638 Aug 31 19:25:03.072116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 553/1146] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:02 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:03.447970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:03.453655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:03.460758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:03.461267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:03.461733 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:03.462529 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:03.463056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:03.463530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:03.498395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-09d1950f-ec3f-42be-ad5a-e8a7f5521581 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054757 Aug 31 19:25:03.498964 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 594/1147] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:03 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:04.094087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:04.094745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:04.101740 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:04.102638 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:04.103251 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:04.104262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:04.105498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:04.106239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:04.274300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:04.282361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-abe41522-dafd-4555-a4e1-966117cd1c9e tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.192929 Aug 31 19:25:04.283195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 554/1148] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:04 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:04.510319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:04.512584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:04.519804 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:04.520281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:04.520751 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:04.521447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:04.521895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:04.523039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:04.556247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-44cd61eb-2380-4ba7-9593-5a1983e4d2c1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049799 Aug 31 19:25:04.556856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 595/1149] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:04 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:05.303585 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:05.304210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:05.310618 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.311088 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.311506 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.312243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.312720 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.313138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.452928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:05.460951 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-72b56c4e-dc0c-45e8-bdaf-f8788d1299fc tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.161299 Aug 31 19:25:05.461500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 555/1150] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:05 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:05.568757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:05.571077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:05.579262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.579745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.580186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.580934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.581386 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.581809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.612602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-08674ab1-e055-4832-b755-c4f4203917ff tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047790 Aug 31 19:25:05.613178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 596/1151] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:05 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:25:05.698794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:05.699276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:05.701235 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:05.707972 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.708447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.708897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.709581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.710020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.710432 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.737436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:25:05.814000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b48205b1-076e-4825-a7e4-0b644266bf50 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 204 len: 0 microversion: 2.1 time: 0.118789 Aug 31 19:25:05.815046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 556/1152] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:25:05 2022] DELETE /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:25:05.825097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:05.826521 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:05.834093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.834573 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.835009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.835707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:05.836158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:05.836600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:05.979679 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:05.988769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-70442c36-af91-4ea6-aa68-6364bd99b2b1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1688 microversion: 2.1 time: 0.168780 Aug 31 19:25:05.989344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 597/1153] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:05 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:06.483467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:06.484282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:06.490913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:06.491416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:06.492147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:06.493113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:06.493570 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:06.493992 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:06.582941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-4a196ddc-6411-46d5-99b8-e8ca1ed98829 req-81fee503-a773-4252-a737-ebb924446bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd38835-5c39-470d-91d3-9bf5b47b2fec", "name": "network-vif-plugged", "status": "completed", "tag": "a7aeda1c-033f-4630-9e3d-cee6e7a973ff"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:06.594328 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-4a196ddc-6411-46d5-99b8-e8ca1ed98829 req-81fee503-a773-4252-a737-ebb924446bcb service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:06.594525 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-4a196ddc-6411-46d5-99b8-e8ca1ed98829 req-81fee503-a773-4252-a737-ebb924446bcb service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:06.594959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-4a196ddc-6411-46d5-99b8-e8ca1ed98829 req-81fee503-a773-4252-a737-ebb924446bcb service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:06.609015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-4a196ddc-6411-46d5-99b8-e8ca1ed98829 req-81fee503-a773-4252-a737-ebb924446bcb service nova] Creating event network-vif-plugged:a7aeda1c-033f-4630-9e3d-cee6e7a973ff for instance efd38835-5c39-470d-91d3-9bf5b47b2fec on hv-cinder-85221 Aug 31 19:25:06.614454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-4a196ddc-6411-46d5-99b8-e8ca1ed98829 req-81fee503-a773-4252-a737-ebb924446bcb service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035067 Aug 31 19:25:06.615517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 598/1154] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:06.640726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:06.649994 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-16b8a1cc-e85f-4e1c-9a14-2c8eeb1331a6 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.170761 Aug 31 19:25:06.650650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 557/1155] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:06 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:07.011857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:07.012562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:07.019472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:07.019952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:07.020388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:07.021112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:07.021565 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:07.021988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:07.153594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:07.162054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-08662583-d03c-4262-ba02-653aecc17a52 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1688 microversion: 2.1 time: 0.154428 Aug 31 19:25:07.162627 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 599/1156] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:07 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:07.671744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:07.672296 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:07.674438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:07.675095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=6 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:07.680732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:07.681212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:07.681637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:07.682325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:07.682772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:07.683190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:07.819892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:07.828329 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9f1898fe-f29a-4189-b7db-a84eb1815f62 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.160746 Aug 31 19:25:07.828936 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 558/1157] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:07 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:08.183265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:08.183878 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:08.185907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:08.192239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:08.192753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:08.193191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:08.193892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:08.194341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:08.194764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:08.329869 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:08.337640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d8deaee9-93a5-4a8e-90d5-7566b3582b38 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1688 microversion: 2.1 time: 0.158251 Aug 31 19:25:08.338208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 600/1158] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:08 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:08.848484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:08.849221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:08.855946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:08.856425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:08.856908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:08.857604 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:08.858056 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:08.858480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:08.992912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:09.001403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5bcb4239-6114-4c94-917a-086777d0f106 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.155960 Aug 31 19:25:09.001930 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 559/1159] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:08 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:09.359163 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:09.359815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:09.366612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:09.367085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:09.367570 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:09.368663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:09.368796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:09.369657 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:09.514547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:09.523564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-75369247-b9f9-402c-a5a2-7296e6b70a19 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1688 microversion: 2.1 time: 0.168031 Aug 31 19:25:09.524198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 601/1160] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:09 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:10.022519 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:10.023298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:10.031371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:10.032002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:10.032947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:10.034164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:10.034750 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:10.035504 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:10.176621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:10.187444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3d2406fc-e0f8-445e-ae40-4a23850f62f2 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.168696 Aug 31 19:25:10.188175 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 560/1161] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:10 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:10.545134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:10.545735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:10.552808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:10.553294 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:10.553739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:10.554568 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:10.555018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:10.555443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:10.572527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:10.697703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:10.706457 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cc579b0d-33ce-4fa2-b30a-51c4189d6b37 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1688 microversion: 2.1 time: 0.165219 Aug 31 19:25:10.707026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 602/1162] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:10 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:11.210639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:11.211245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:11.217821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:11.218301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:11.218737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:11.219422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:11.219870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:11.220433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:11.359486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:11.369269 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b6f529c-535d-4b6d-8abe-ad85ce8fc93a tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.162266 Aug 31 19:25:11.370058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 561/1163] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:11 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:11.727316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:11.727953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:11.734594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:11.735739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:11.736187 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:11.736929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:11.737387 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:11.737818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:11.877282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:11.886587 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7e38acf3-37a2-433b-9b47-ed025dd0291f tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1688 microversion: 2.1 time: 0.161991 Aug 31 19:25:11.886587 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 603/1164] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:11 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:12.390262 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:12.390821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:12.398515 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:12.399008 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:12.399446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:12.400148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:12.400628 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:12.401058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:12.474605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-79905075-e665-4e16-bee9-84ae7502888d req-8f614388-5340-4708-a04a-23b65bdaa200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d389fb4-28b6-4d7e-80bc-fb896c5bf004", "name": "network-vif-deleted", "tag": "1a01f436-a378-4dc6-a024-41f23bb205d1"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:12.484658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-79905075-e665-4e16-bee9-84ae7502888d req-8f614388-5340-4708-a04a-23b65bdaa200 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:12.485615 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-79905075-e665-4e16-bee9-84ae7502888d req-8f614388-5340-4708-a04a-23b65bdaa200 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:12.486141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-79905075-e665-4e16-bee9-84ae7502888d req-8f614388-5340-4708-a04a-23b65bdaa200 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:12.497917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-79905075-e665-4e16-bee9-84ae7502888d req-8f614388-5340-4708-a04a-23b65bdaa200 service nova] Creating event network-vif-deleted:1a01f436-a378-4dc6-a024-41f23bb205d1 for instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 on hv-cinder-85221 Aug 31 19:25:12.504322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-79905075-e665-4e16-bee9-84ae7502888d req-8f614388-5340-4708-a04a-23b65bdaa200 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Aug 31 19:25:12.505585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 604/1165] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:12.552779 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:12.561729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dea2dbec-0c05-431d-996c-bccc04f31eab tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1366 microversion: 2.1 time: 0.175370 Aug 31 19:25:12.562580 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 562/1166] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:12 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:12.909855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:12.910463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:12.918148 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:12.918636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:12.919099 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:12.919801 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:12.920440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:12.920905 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:12.986778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:12.994785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-51682867-986c-4568-b61d-7c36a247f9b2 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1329 microversion: 2.1 time: 0.091410 Aug 31 19:25:12.995360 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 605/1167] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:12 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1329 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:13.583923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:13.585252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:13.592837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:13.592837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:13.593104 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:13.593797 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:13.594195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:13.595471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:13.598753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:13.728142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:13.736393 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0986fdae-3f19-4867-9c60-7d28113f3517 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1555 microversion: 2.1 time: 0.156403 Aug 31 19:25:13.736990 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 563/1168] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:13 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:13.756670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:13.757190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:13.763302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:13.763780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:13.764218 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:13.764959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:13.765420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:13.765849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:13.845222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-07f80869-5953-4378-bda7-a9ac5526d492 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092120 Aug 31 19:25:13.845858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 606/1169] 10.222.0.95 () {58 vars in 1275 bytes} [Wed Aug 31 19:25:13 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:14.018011 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:14.018620 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:14.024507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.025018 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.025451 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.026138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.026587 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.027005 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.059623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.060098 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.060533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.061011 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'fault' on Instance uuid 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:14.129124 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:14.141893 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-38729597-18f6-42ad-bf68-c7ea4d38a6e8 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 200 len: 1334 microversion: 2.1 time: 0.123727 Aug 31 19:25:14.142622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 564/1170] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:14 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 1334 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:14.508654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1614914604"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:14.509216 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:14.515066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.515775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.516623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.517667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.518131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.518562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.728084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.network.security_group_api [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Removing security group c174b445-04d2-4b4a-b920-7a252422fe97 from port f96dd63c-f856-4c10-87ce-0a63e89f3d3b Aug 31 19:25:15.051662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-215496ea-000a-4683-9b90-bd6818bdf7cb req-a34c12f1-dd5c-473b-851f-b626dd877fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd38835-5c39-470d-91d3-9bf5b47b2fec", "tag": "a7aeda1c-033f-4630-9e3d-cee6e7a973ff"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:15.065033 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-215496ea-000a-4683-9b90-bd6818bdf7cb req-a34c12f1-dd5c-473b-851f-b626dd877fad service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:15.065624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-215496ea-000a-4683-9b90-bd6818bdf7cb req-a34c12f1-dd5c-473b-851f-b626dd877fad service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:15.066155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-215496ea-000a-4683-9b90-bd6818bdf7cb req-a34c12f1-dd5c-473b-851f-b626dd877fad service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:15.089070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-215496ea-000a-4683-9b90-bd6818bdf7cb req-a34c12f1-dd5c-473b-851f-b626dd877fad service nova] Creating event network-changed:a7aeda1c-033f-4630-9e3d-cee6e7a973ff for instance efd38835-5c39-470d-91d3-9bf5b47b2fec on hv-cinder-85221 Aug 31 19:25:15.094233 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-215496ea-000a-4683-9b90-bd6818bdf7cb req-a34c12f1-dd5c-473b-851f-b626dd877fad service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047326 Aug 31 19:25:15.102957 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 565/1171] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:15.164484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.165735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: 6d389fb4-28b6-4d7e-80bc-fb896c5bf004] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:15.175407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:15.175945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:15.176342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:15.177136 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:15.177609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:15.177958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:15.195987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] HTTP exception thrown: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 could not be found. Aug 31 19:25:15.197357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e53f24d8-3854-4c48-9e11-d264d145de79 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/action" status: 202 len: 0 microversion: 2.1 time: 0.691530 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Request method failure captured: Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 HTTP/1.1 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PeVr-VH7V6H-jdY3ceG7PwqENqKNvCM8u4JaVcyvyGnstm48zEmYLv80PCi8p3GbTd5yBYWIeNZfxczjK__7hbOaO72FX4-dm6B09eskqpUkjGsmWBTSX_VPgolDJVn79VVcGnGfMXphvUiyFakP990ImyMlyTAwjRfrjtQKMu3qY Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:25:15.197679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: fd0f7f51482040d7a89df3f7502c2638 Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 could not be found. Aug 31 19:25:15.199446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '6d389fb4-28b6-4d7e-80bc-fb896c5bf004'} Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 could not be found. Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:15.200375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 could not be found. Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 could not be found. Aug 31 19:25:15.201971 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.203293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Returning 404 to user: Instance 6d389fb4-28b6-4d7e-80bc-fb896c5bf004 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:15.204421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 607/1172] 10.222.0.95 () {60 vars in 1278 bytes} [Wed Aug 31 19:25:14 2022] POST /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:15.209524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e768a02b-d0dd-45c9-bab4-ab290879f9e6 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004" status: 404 len: 111 microversion: 2.1 time: 0.048996 Aug 31 19:25:15.213728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 566/1173] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:15 2022] GET /compute/v2.1/servers/6d389fb4-28b6-4d7e-80bc-fb896c5bf004 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:25:15.218755 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e6863c01-6f9d-43c4-af50-02bbb7c58d10 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '.version_select at 0x7f975fb58160>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.273617 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e6863c01-6f9d-43c4-af50-02bbb7c58d10 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227283502" status: 202 len: 0 microversion: 2.1 time: 0.058824 Aug 31 19:25:15.274650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 608/1174] 10.222.0.95 () {58 vars in 1218 bytes} [Wed Aug 31 19:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227283502 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:17.049948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:17.050474 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:17.051522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-3608872a-dc24-423f-91bb-9adad1e8d53f req-df45ec75-4082-46dd-b17e-7a674981b9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:17.056883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.057359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.057790 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.058484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.059114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.059716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.063836 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3608872a-dc24-423f-91bb-9adad1e8d53f req-df45ec75-4082-46dd-b17e-7a674981b9df service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.064315 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3608872a-dc24-423f-91bb-9adad1e8d53f req-df45ec75-4082-46dd-b17e-7a674981b9df service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.064789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-3608872a-dc24-423f-91bb-9adad1e8d53f req-df45ec75-4082-46dd-b17e-7a674981b9df service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.075298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-3608872a-dc24-423f-91bb-9adad1e8d53f req-df45ec75-4082-46dd-b17e-7a674981b9df service nova] Creating event network-changed:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:25:17.080279 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-3608872a-dc24-423f-91bb-9adad1e8d53f req-df45ec75-4082-46dd-b17e-7a674981b9df service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033921 Aug 31 19:25:17.081289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 609/1175] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:17.119199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-026528ca-d35c-4aaf-9f0e-df4010778144 req-d38aaf16-8e44-4f0a-8bc8-e1ba4fe123d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:17.130581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-026528ca-d35c-4aaf-9f0e-df4010778144 req-d38aaf16-8e44-4f0a-8bc8-e1ba4fe123d6 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.131054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-026528ca-d35c-4aaf-9f0e-df4010778144 req-d38aaf16-8e44-4f0a-8bc8-e1ba4fe123d6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.131485 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-026528ca-d35c-4aaf-9f0e-df4010778144 req-d38aaf16-8e44-4f0a-8bc8-e1ba4fe123d6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.143785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-026528ca-d35c-4aaf-9f0e-df4010778144 req-d38aaf16-8e44-4f0a-8bc8-e1ba4fe123d6 service nova] Creating event network-changed:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:25:17.149101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-026528ca-d35c-4aaf-9f0e-df4010778144 req-d38aaf16-8e44-4f0a-8bc8-e1ba4fe123d6 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033823 Aug 31 19:25:17.149780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 610/1176] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:17.175236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lazy-loading 'services' on Instance uuid e30ff212-d47d-438e-9b2e-55ae25aae33c {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:17.271483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9ecb8c98-fa4c-4370-b19f-f88dac58fd5a tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments/6ffd52d2-3124-4613-8ae5-c58d30f34065" status: 202 len: 0 microversion: 2.1 time: 0.226864 Aug 31 19:25:17.276967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 567/1177] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:25:17 2022] DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments/6ffd52d2-3124-4613-8ae5-c58d30f34065 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:17.286543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:17.289196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:17.296206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.296992 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.298170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.299403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.300212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.300866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.338891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8b42625f-a09f-4226-a657-e7711699ccde tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057147 Aug 31 19:25:17.339478 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 611/1178] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:17 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:18.352855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:18.355179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:18.357879 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:18.358377 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:18.361347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.361813 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.362240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.362921 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.363362 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.363783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.365001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.365482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.365917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.366683 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.367132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.367553 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.394707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:25:18.397897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b0e5a7d9-12ad-4e40-8cf2-1f0d32e52cc3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049941 Aug 31 19:25:18.398667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 568/1179] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:18 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:18.478463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-296d9238-73f6-4ed4-9bb7-3ee0e5c6b976 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "DELETE /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 204 len: 0 microversion: 2.1 time: 0.123876 Aug 31 19:25:18.482114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 612/1180] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:25:18 2022] DELETE /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:25:18.490965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:18.491581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:18.497575 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.498272 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.498716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.499475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.500001 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.500467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.632395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:18.640199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-27da62ee-e4bc-402d-9a2f-517c47136b02 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1507 microversion: 2.1 time: 0.155992 Aug 31 19:25:18.640783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 569/1181] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:18 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:19.412077 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:19.414397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:19.420785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.421257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.421881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.422571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.423024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.423540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.454283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ccda50c9-e207-454f-8da4-ae8227b33aa1 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046245 Aug 31 19:25:19.454865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 613/1182] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:19 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:25:19.465555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:19.466080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:19.473299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.473773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.474199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.474882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.475354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.475768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.553772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] HTTP exception thrown: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c is not attached to volume 6ffd52d2-3124-4613-8ae5-c58d30f34065 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Request method failure captured: Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments/6ffd52d2-3124-4613-8ae5-c58d30f34065 HTTP/1.1 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7SwtrqRlq0hNffRICbVaKwamWm9xJn3d5n7rmbI6efIsAw1xSxNc4AeidcaAYvyadJYBcvCPw6DmGGUOI8LBi8iixT9y9enQtv3GKkhtutsnWry99CMM6tn6SkmXvO7HGrvWxIHMgM_DTFrvT7v-r1MoYaYA7f317cHi47xHAor1QQ Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: a16d7c3be2644b64b9d43e77d9e45804 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestMinimumBasicScenario-660621054 Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:25:19.561378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestMinimumBasicScenario-660621054 Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: a16d7c3be2644b64b9d43e77d9e45804 Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestMinimumBasicScenario-660621054 Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-TestMinimumBasicScenario-660621054-project Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 3e8d388698c6493c83f83059727a6188 Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestMinimumBasicScenario-660621054-project Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:25:19.563785 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c is not attached to volume 6ffd52d2-3124-4613-8ae5-c58d30f34065 Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'server_id': 'e30ff212-d47d-438e-9b2e-55ae25aae33c', 'id': '6ffd52d2-3124-4613-8ae5-c58d30f34065'} Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6ffd52d2-3124-4613-8ae5-c58d30f34065. Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:19.564675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c is not attached to volume 6ffd52d2-3124-4613-8ae5-c58d30f34065 Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c is not attached to volume 6ffd52d2-3124-4613-8ae5-c58d30f34065 Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:19.566259 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Returning 404 to user: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c is not attached to volume 6ffd52d2-3124-4613-8ae5-c58d30f34065 {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:19.567340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-75df05d1-a34c-4587-9e1e-d5af7b492d87 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments/6ffd52d2-3124-4613-8ae5-c58d30f34065" status: 404 len: 154 microversion: 2.1 time: 0.101409 Aug 31 19:25:19.567340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 570/1183] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:25:19 2022] DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c/os-volume_attachments/6ffd52d2-3124-4613-8ae5-c58d30f34065 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:19.662401 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:19.663055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:19.669025 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.669511 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.679355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.679355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.679355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.679355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.812759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.822105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb679f1e-d8e2-4715-9fec-a6ce7a69bcd1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1507 microversion: 2.1 time: 0.164705 Aug 31 19:25:19.822669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 614/1184] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:19 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:20.057325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-c9e6c05d-ba82-4994-8c18-e3d26df59433 req-a0974170-8d25-4de2-ad63-5daa26bb12b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a", "name": "network-vif-deleted", "tag": "241c7767-5424-40a4-b0ce-0e9e433d2649"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:20.069787 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c9e6c05d-ba82-4994-8c18-e3d26df59433 req-a0974170-8d25-4de2-ad63-5daa26bb12b5 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.070263 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c9e6c05d-ba82-4994-8c18-e3d26df59433 req-a0974170-8d25-4de2-ad63-5daa26bb12b5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.070695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c9e6c05d-ba82-4994-8c18-e3d26df59433 req-a0974170-8d25-4de2-ad63-5daa26bb12b5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.085148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-c9e6c05d-ba82-4994-8c18-e3d26df59433 req-a0974170-8d25-4de2-ad63-5daa26bb12b5 service nova] Creating event network-vif-deleted:241c7767-5424-40a4-b0ce-0e9e433d2649 for instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a on hv-cinder-85221 Aug 31 19:25:20.089935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-c9e6c05d-ba82-4994-8c18-e3d26df59433 req-a0974170-8d25-4de2-ad63-5daa26bb12b5 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036319 Aug 31 19:25:20.090845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 571/1185] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:20.713602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.714095 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.721355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.721827 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.722254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.722933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.723383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.723797 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.749560 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:25:20.825722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-22a9f302-c92a-4355-a0d8-e50228398aec tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 204 len: 0 microversion: 2.1 time: 0.116098 Aug 31 19:25:20.826212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 615/1186] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:25:20 2022] DELETE /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:25:20.835839 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.836539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.842836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.843324 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.843634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.843771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.844687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.845676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.846139 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.846563 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.850854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.851471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.851959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.852684 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.853144 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.853571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.886220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.886704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.887139 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.887583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'fault' on Instance uuid fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:20.942829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.950494 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-96cba415-5137-4898-813c-c4cea6a3a38e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1312 microversion: 2.1 time: 0.111068 Aug 31 19:25:20.950926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 616/1187] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:20 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:21.002690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:21.010273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b6eeea26-a581-4961-bb26-a5fb0378ccbd tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1553 microversion: 2.1 time: 0.179123 Aug 31 19:25:21.010860 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 572/1188] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:20 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:21.971939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:21.972596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:21.979211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.979694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.980134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:21.980858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.981313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.981740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.013384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.013863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.014302 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.014777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'fault' on Instance uuid fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:22.031862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:22.032908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:22.039389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.040021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.040464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.041194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.041708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.042137 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.060020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.068976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a486dd92-d14d-47a0-b4b4-0a1ec6e8be18 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1312 microversion: 2.1 time: 0.101150 Aug 31 19:25:22.069550 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 617/1189] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:21 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:22.174279 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.182168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-da59aebe-a9c3-41b1-aad2-74012f029921 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1553 microversion: 2.1 time: 0.154152 Aug 31 19:25:22.182732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 573/1190] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:22 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:23.089699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:23.090345 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:23.096782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.097262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.097700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.098563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.099014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.099440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.131444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.131945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.132371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.132839 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'fault' on Instance uuid fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:23.135603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:23.174636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:23.182211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-92f10a45-0b61-4b67-8b1e-6e948d67e488 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 200 len: 1312 microversion: 2.1 time: 0.096383 Aug 31 19:25:23.182768 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 618/1191] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:23 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:23.203146 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:23.204363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:23.210728 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.211198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.211624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.212305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.212884 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.213417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.342016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:23.349663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0d899970-ab9a-454c-bee9-5476f6a51060 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1553 microversion: 2.1 time: 0.150345 Aug 31 19:25:23.350221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 574/1192] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:23 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:24.203112 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:24.204618 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:24.211211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.214180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.214645 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.215372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.215832 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.216265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.231600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] HTTP exception thrown: Instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a could not be found. Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Request method failure captured: Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a HTTP/1.1 Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PeVr-VH7V6H-jdY3ceG7PwqENqKNvCM8u4JaVcyvyGnstm48zEmYLv80PCi8p3GbTd5yBYWIeNZfxczjK__7hbOaO72FX4-dm6B09eskqpUkjGsmWBTSX_VPgolDJVn79VVcGnGfMXphvUiyFakP990ImyMlyTAwjRfrjtQKMu3qY Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:25:24.233373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: fd0f7f51482040d7a89df3f7502c2638 Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a could not be found. Aug 31 19:25:24.235170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a'} Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a could not be found. Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:24.235941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a could not be found. Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a could not be found. Aug 31 19:25:24.237436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:24.239225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Returning 404 to user: Instance fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:24.239225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-37aa5fd4-bbda-4ebf-99d7-a4eece964f2e tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a" status: 404 len: 111 microversion: 2.1 time: 0.035683 Aug 31 19:25:24.239225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 619/1193] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:24 2022] GET /compute/v2.1/servers/fb6a7791-d2a2-4dbd-bfe3-0f1aab71bd8a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:24.244854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:24.245633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:24.252255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.252766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.253200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.253914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.254343 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.254772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.281115 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:25:24.361591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9173e74b-17d1-48e0-9fb5-8e35104409e1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "DELETE /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 204 len: 0 microversion: 2.1 time: 0.120964 Aug 31 19:25:24.362647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 575/1194] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:25:24 2022] DELETE /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:25:24.371602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:24.372397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:24.380018 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:24.380707 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:24.381737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.382574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.383181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.384107 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.385220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.386995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.387313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.387897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.388428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.389260 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.389814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.390505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.598426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:24.611650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-54b08808-6bd8-46a7-b286-5709c7fafc6c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.237431 Aug 31 19:25:24.614165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 576/1195] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:24 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:24.616038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:24.620845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-ede04994-6d6d-45a3-b6ed-35f7ed6267bf req-9a380a96-e2d3-42e4-864c-248b469b9640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30ff212-d47d-438e-9b2e-55ae25aae33c", "name": "network-vif-deleted", "tag": "f96dd63c-f856-4c10-87ce-0a63e89f3d3b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:24.624211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-752a1788-19e9-4453-9163-8b97ac4674c7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1553 microversion: 2.1 time: 0.257324 Aug 31 19:25:24.626229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 620/1196] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:24 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:24.633237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ede04994-6d6d-45a3-b6ed-35f7ed6267bf req-9a380a96-e2d3-42e4-864c-248b469b9640 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.633664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ede04994-6d6d-45a3-b6ed-35f7ed6267bf req-9a380a96-e2d3-42e4-864c-248b469b9640 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.634081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-ede04994-6d6d-45a3-b6ed-35f7ed6267bf req-9a380a96-e2d3-42e4-864c-248b469b9640 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.645705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-ede04994-6d6d-45a3-b6ed-35f7ed6267bf req-9a380a96-e2d3-42e4-864c-248b469b9640 service nova] Creating event network-vif-deleted:f96dd63c-f856-4c10-87ce-0a63e89f3d3b for instance e30ff212-d47d-438e-9b2e-55ae25aae33c on hv-cinder-85221 Aug 31 19:25:24.650723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-ede04994-6d6d-45a3-b6ed-35f7ed6267bf req-9a380a96-e2d3-42e4-864c-248b469b9640 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035326 Aug 31 19:25:24.651303 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 577/1197] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:25.635341 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:25.635979 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:25.643353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.643844 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.644288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.645039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.645501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.645960 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.647866 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:25.648695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:25.655843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.657051 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.657940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.658735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.659297 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.659821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.772940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:25.780642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2255fe5a-48ee-4285-b1a5-a0db05e8dbf4 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1511 microversion: 2.1 time: 0.137422 Aug 31 19:25:25.781314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 578/1198] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:25 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1511 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:25.883353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:25.883959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:25.890281 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.891690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.892477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.893313 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.893883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.894126 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:25.894492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.902044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4e30f0d2-e07f-45de-b0c9-3e1c1b269ed1 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.270584 Aug 31 19:25:25.902837 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 621/1199] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:25 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:25.909323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-2dc08edc-f89b-41ed-8ea3-2571a396f165 req-40637ae3-7ba0-4287-bf61-a28d0911fc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:25.919166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2dc08edc-f89b-41ed-8ea3-2571a396f165 req-40637ae3-7ba0-4287-bf61-a28d0911fc6a service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.919640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2dc08edc-f89b-41ed-8ea3-2571a396f165 req-40637ae3-7ba0-4287-bf61-a28d0911fc6a service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.920207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-2dc08edc-f89b-41ed-8ea3-2571a396f165 req-40637ae3-7ba0-4287-bf61-a28d0911fc6a service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.926273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:25:25.929478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:25.934629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-2dc08edc-f89b-41ed-8ea3-2571a396f165 req-40637ae3-7ba0-4287-bf61-a28d0911fc6a service nova] Creating event network-changed:facbf5d7-797a-4f5f-8a68-930bc7130258 for instance a83d3294-0902-4f21-a7b9-45b2b5229c52 on hv-cinder-85221 Aug 31 19:25:25.940612 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-2dc08edc-f89b-41ed-8ea3-2571a396f165 req-40637ae3-7ba0-4287-bf61-a28d0911fc6a service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036001 Aug 31 19:25:25.942332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 622/1200] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:26.009625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ea4c90ee-f87c-4967-9d6b-20379a275edf tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 204 len: 0 microversion: 2.1 time: 0.130256 Aug 31 19:25:26.010522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 579/1201] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:25:25 2022] DELETE /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:25:26.020123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:26.020910 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:26.027042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.027516 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.027945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.028649 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.029095 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.029507 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.166667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:26.175982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b720c68a-1124-41a3-97f0-f7f6e11ed467 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.159786 Aug 31 19:25:26.175982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 623/1202] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:26 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:26.803964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:26.804792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:26.811204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.811671 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.812094 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.813530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.814083 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.814494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.879901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:26.887605 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0d1a778-fbdb-4a8e-9177-734275b24fd5 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1511 microversion: 2.1 time: 0.087794 Aug 31 19:25:26.888163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 580/1203] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:26 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:26.923530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:26.924134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:26.930084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.930561 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.930996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.931681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.932130 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.932552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.064477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:27.072075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-82631a71-6727-4744-82e7-2810b5fdab8c tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.152822 Aug 31 19:25:27.072651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 624/1204] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:26 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:27.196715 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:27.197353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:27.203437 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.204255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.204508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.205218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.205670 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.206091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.334619 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:27.342290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d5fdfc56-fb37-43e6-bde4-b93aa0cfa02a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.149581 Aug 31 19:25:27.342851 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 581/1205] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:27 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:27.910384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:27.911001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:27.916543 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:27.918384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.918874 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.919316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.920080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.920537 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.921018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.989852 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:27.997640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-019a4972-b52d-4f7b-b62b-6a8c91549daf tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1342 microversion: 2.1 time: 0.092159 Aug 31 19:25:27.998211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 625/1206] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:27 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1342 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:28.092987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:28.093591 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:28.100163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.100679 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.101114 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.101802 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.102256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.102680 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.230841 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.239135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a7914489-cf08-4347-a60c-b58e7a11e9a5 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.150016 Aug 31 19:25:28.239702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 582/1207] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:28 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:28.363506 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:28.364166 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:28.370712 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.371189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.371621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.372306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.372782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.373202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.502935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.510701 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c8832f60-90e2-4986-b61e-f45c7510f98d tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.151225 Aug 31 19:25:28.511391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 626/1208] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:28 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:28.554465 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:28.554947 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:28.561033 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.561503 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.561928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.563215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.563783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.564202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.588697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-108001be-7b37-479c-bce0-221c24a6bfde tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/ips" status: 200 len: 152 microversion: 2.20 time: 0.038083 Aug 31 19:25:28.589357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 583/1209] 10.222.0.95 () {60 vars in 1289 bytes} [Wed Aug 31 19:25:28 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:25:29.018818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:29.019405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:29.025229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.025739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.026324 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.027070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.027651 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.028079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.093585 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.102061 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-de711231-9dc4-49c5-b6b7-0fc06e553eb9 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1342 microversion: 2.1 time: 0.087240 Aug 31 19:25:29.102633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 627/1210] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:29 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:29.261709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:29.262491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:29.270101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.270517 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.270948 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.271636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.272087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.272510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.401154 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.409703 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1acaea91-760b-4367-bea5-068991ebd0bc tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.152000 Aug 31 19:25:29.410264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 584/1211] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:29 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:29.533170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:29.533702 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:29.540029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.540708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.541153 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.541847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.542304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.542727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.676064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.683735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4f17e39c-357f-40f3-be3e-7fd7d125d74c tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.155612 Aug 31 19:25:29.684287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 628/1212] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:29 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:30.123311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:30.123924 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:30.131016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.131504 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.131939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.132662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.133117 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.133542 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.198544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.206926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-18eb4008-bc69-46ab-8bc4-3f7f3a838923 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1342 microversion: 2.1 time: 0.087396 Aug 31 19:25:30.216967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 585/1213] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:30 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:30.431204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:30.431767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:30.437692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.438688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.439212 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.439897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.440342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.441072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.587155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.596020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-13e6bb4c-9a68-44b7-9330-884fcaa37a65 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1521 microversion: 2.1 time: 0.168947 Aug 31 19:25:30.596613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 629/1214] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:30 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:30.706306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:30.707315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:30.714371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.715203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.716695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.716695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.717211 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.717632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.910308 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.918598 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-20d1f0af-1209-4ed2-9f5f-cefd9e87c231 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1567 microversion: 2.1 time: 0.216761 Aug 31 19:25:30.919166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 586/1215] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:30 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:31.236064 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:31.236768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.240372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.241271 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.247509 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.247997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.248434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.249608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.250013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.250444 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.253533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.254660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.256009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.257079 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.260507 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.261101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.276915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'flavor' on Instance uuid 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:31.306639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.306749 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.307248 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.307746 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lazy-loading 'fault' on Instance uuid e30ff212-d47d-438e-9b2e-55ae25aae33c {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:31.363696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e8d388698c6493c83f83059727a6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16d7c3be2644b64b9d43e77d9e45804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.375594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8747dc63-650b-4d73-ab62-52d9d7a7f9a3 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 200 len: 1347 microversion: 2.1 time: 0.148215 Aug 31 19:25:31.376621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 630/1216] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 1347 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:31.480702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-489db845-a0e0-4227-beef-3ded2dfe74db tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/action" status: 202 len: 0 microversion: 2.20 time: 0.248932 Aug 31 19:25:31.487879 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 587/1217] 10.222.0.95 () {62 vars in 1319 bytes} [Wed Aug 31 19:25:31 2022] POST /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:25:31.491659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.494156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.501204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.501952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.502586 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.503730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.504194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.506618 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.567040 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-0a912ada-7c67-4eb5-9213-b82bbfc4df3f req-7cb22aae-3a97-460d-a4e0-a8280b422766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7220888-b7b3-4d53-80fd-85596b3370cb", "name": "network-vif-deleted", "tag": "96007021-e82b-4fbd-8d7a-9aca8d2f3dca"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:31.577791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-0a912ada-7c67-4eb5-9213-b82bbfc4df3f req-7cb22aae-3a97-460d-a4e0-a8280b422766 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.578273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-0a912ada-7c67-4eb5-9213-b82bbfc4df3f req-7cb22aae-3a97-460d-a4e0-a8280b422766 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.578705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-0a912ada-7c67-4eb5-9213-b82bbfc4df3f req-7cb22aae-3a97-460d-a4e0-a8280b422766 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.591625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-0a912ada-7c67-4eb5-9213-b82bbfc4df3f req-7cb22aae-3a97-460d-a4e0-a8280b422766 service nova] Creating event network-vif-deleted:96007021-e82b-4fbd-8d7a-9aca8d2f3dca for instance d7220888-b7b3-4d53-80fd-85596b3370cb on hv-cinder-85221 Aug 31 19:25:31.598148 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-0a912ada-7c67-4eb5-9213-b82bbfc4df3f req-7cb22aae-3a97-460d-a4e0-a8280b422766 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035300 Aug 31 19:25:31.599125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 588/1218] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:31.622345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.623374 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.631556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.633025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.633666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.634565 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.635357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.636026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.803394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.812325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d569ca4d-0914-44d3-b3d0-20ecd4858f51 tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1479 microversion: 2.1 time: 0.198613 Aug 31 19:25:31.812932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 589/1219] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1479 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:31.857202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-67faf8b8-e2d6-4ad5-a98f-68acf6a72636 req-f1f08118-a559-45e6-8daf-e9647cc2dfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83d3294-0902-4f21-a7b9-45b2b5229c52", "name": "network-vif-deleted", "tag": "facbf5d7-797a-4f5f-8a68-930bc7130258"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:31.868024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-67faf8b8-e2d6-4ad5-a98f-68acf6a72636 req-f1f08118-a559-45e6-8daf-e9647cc2dfff service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.868191 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.868908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-67faf8b8-e2d6-4ad5-a98f-68acf6a72636 req-f1f08118-a559-45e6-8daf-e9647cc2dfff service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.869547 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-67faf8b8-e2d6-4ad5-a98f-68acf6a72636 req-f1f08118-a559-45e6-8daf-e9647cc2dfff service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.878160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.879924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.881330 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8d60df85-7cfd-4771-979a-a4317f8a3220 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.394903 Aug 31 19:25:31.882389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 631/1220] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:31.883499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-67faf8b8-e2d6-4ad5-a98f-68acf6a72636 req-f1f08118-a559-45e6-8daf-e9647cc2dfff service nova] Creating event network-vif-deleted:facbf5d7-797a-4f5f-8a68-930bc7130258 for instance a83d3294-0902-4f21-a7b9-45b2b5229c52 on hv-cinder-85221 Aug 31 19:25:31.889865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-67faf8b8-e2d6-4ad5-a98f-68acf6a72636 req-f1f08118-a559-45e6-8daf-e9647cc2dfff service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036471 Aug 31 19:25:31.890544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 590/1221] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:31.940056 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.940699 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.947425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.948032 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.949039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.950496 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.951044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.951553 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.025186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:32.035602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9d0e8e67-d390-48fa-b0ce-83f89299ac5a tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1500 microversion: 2.1 time: 0.099933 Aug 31 19:25:32.036251 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 632/1222] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1500 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:32.397490 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.398223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] [instance: e30ff212-d47d-438e-9b2e-55ae25aae33c] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:32.404554 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.405061 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.405495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.406181 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.406630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.407967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.423723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] HTTP exception thrown: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c could not be found. Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Request method failure captured: Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c HTTP/1.1 Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7SwtrqRlq0hNffRICbVaKwamWm9xJn3d5n7rmbI6efIsAw1xSxNc4AeidcaAYvyadJYBcvCPw6DmGGUOI8LBi8iixT9y9enQtv3GKkhtutsnWry99CMM6tn6SkmXvO7HGrvWxIHMgM_DTFrvT7v-r1MoYaYA7f317cHi47xHAor1QQ Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: a16d7c3be2644b64b9d43e77d9e45804 Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestMinimumBasicScenario-660621054 Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:25:32.425395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a16d7c3be2644b64b9d43e77d9e45804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestMinimumBasicScenario-660621054 Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: a16d7c3be2644b64b9d43e77d9e45804 Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestMinimumBasicScenario-660621054 Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-TestMinimumBasicScenario-660621054-project Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 3e8d388698c6493c83f83059727a6188 Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestMinimumBasicScenario-660621054-project Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c could not be found. Aug 31 19:25:32.427068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'e30ff212-d47d-438e-9b2e-55ae25aae33c'} Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c could not be found. Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:32.427908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c could not be found. Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c could not be found. Aug 31 19:25:32.429243 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:25:32.430407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Returning 404 to user: Instance e30ff212-d47d-438e-9b2e-55ae25aae33c could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:32.430407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8d1c6df6-4cf3-482c-8868-42dc9fb97a33 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c" status: 404 len: 111 microversion: 2.1 time: 0.033490 Aug 31 19:25:32.430407 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 591/1223] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/servers/e30ff212-d47d-438e-9b2e-55ae25aae33c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:32.435637 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-941e0443-8978-4478-a801-c82a6f892db7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] Calling method '.version_select at 0x7f975fd1d820>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.454654 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-941e0443-8978-4478-a801-c82a6f892db7 tempest-TestMinimumBasicScenario-660621054 tempest-TestMinimumBasicScenario-660621054-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-430805820" status: 202 len: 0 microversion: 2.1 time: 0.022788 Aug 31 19:25:32.455236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 633/1224] 10.222.0.95 () {58 vars in 1269 bytes} [Wed Aug 31 19:25:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-430805820 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:32.833677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.834325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:32.840832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.841162 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.841589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.842261 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.842701 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.843268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.880077 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.880628 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.881237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.881685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lazy-loading 'fault' on Instance uuid d7220888-b7b3-4d53-80fd-85596b3370cb {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:32.906225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.907633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:32.915378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.915866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.916301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.917181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.917633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.918058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.926212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd0f7f51482040d7a89df3f7502c2638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1342c2dbb1c41dca6061505220d9de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:32.934493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e517cbe0-eca3-4e7a-9b0b-aab71706dbfb tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 200 len: 1312 microversion: 2.1 time: 0.104527 Aug 31 19:25:32.935163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 592/1225] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:33.057843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.058456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:33.065830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.066352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.066792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.067231 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.070961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.071641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.072817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.074899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.076596 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.078019 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bf2cc9a5-9ec5-42fc-b0e5-d4976138f242 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.175759 Aug 31 19:25:33.078720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 634/1226] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:25:33.184195 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.192800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e8280cc-b030-4d07-a540-cbacc83bb61b tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1381 microversion: 2.1 time: 0.139775 Aug 31 19:25:33.193428 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 593/1227] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1381 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:33.958201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.958743 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] [instance: d7220888-b7b3-4d53-80fd-85596b3370cb] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:33.965463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.965947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.966382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.967083 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.967535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.967961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.982547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] HTTP exception thrown: Instance d7220888-b7b3-4d53-80fd-85596b3370cb could not be found. Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Request method failure captured: Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb HTTP/1.1 Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PeVr-VH7V6H-jdY3ceG7PwqENqKNvCM8u4JaVcyvyGnstm48zEmYLv80PCi8p3GbTd5yBYWIeNZfxczjK__7hbOaO72FX4-dm6B09eskqpUkjGsmWBTSX_VPgolDJVn79VVcGnGfMXphvUiyFakP990ImyMlyTAwjRfrjtQKMu3qY Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:25:33.984468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/a1342c2dbb1c41dca6061505220d9de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: a1342c2dbb1c41dca6061505220d9de7 Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-688156531 Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: fd0f7f51482040d7a89df3f7502c2638 Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-688156531-project Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance d7220888-b7b3-4d53-80fd-85596b3370cb could not be found. Aug 31 19:25:33.987883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'd7220888-b7b3-4d53-80fd-85596b3370cb'} Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7220888-b7b3-4d53-80fd-85596b3370cb could not be found. Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:33.989933 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7220888-b7b3-4d53-80fd-85596b3370cb could not be found. Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7220888-b7b3-4d53-80fd-85596b3370cb could not be found. Aug 31 19:25:33.991443 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:33.993438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] Returning 404 to user: Instance d7220888-b7b3-4d53-80fd-85596b3370cb could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:33.993438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ace2a302-b2d9-4c0a-a786-60b13e4e77cd tempest-ServerRescueNegativeTestJSON-688156531 tempest-ServerRescueNegativeTestJSON-688156531-project] 10.222.0.95 "GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb" status: 404 len: 111 microversion: 2.1 time: 0.032483 Aug 31 19:25:33.993438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 635/1228] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/servers/d7220888-b7b3-4d53-80fd-85596b3370cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:34.103666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:34.105961 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:34.115869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.116458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.116939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.117646 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.118128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.118559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.220081 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:34.223691 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:34.234619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.236085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.237368 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.238560 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.239259 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.239700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.305520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.306271 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.306702 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.307230 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lazy-loading 'fault' on Instance uuid a83d3294-0902-4f21-a7b9-45b2b5229c52 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:25:34.478215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854d5db6c7f64422a946d5284570e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c019992192497d9832594a889da9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.490451 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7d667ab-20b3-4645-9d48-9517b0134d33 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 200 len: 1386 microversion: 2.1 time: 0.276941 Aug 31 19:25:34.491272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 636/1229] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:34 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 1386 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:34.602708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.605783 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:34.615651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.617149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.618709 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-979fb1c2-d460-49b4-a7f5-8f3b9d36ed4a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.518578 Aug 31 19:25:34.619482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 594/1230] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:34 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:35.525232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:35.525855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] [instance: a83d3294-0902-4f21-a7b9-45b2b5229c52] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:35.536708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.537584 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.538179 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.539111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.539722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.540305 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.557984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] HTTP exception thrown: Instance a83d3294-0902-4f21-a7b9-45b2b5229c52 could not be found. Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Request method failure captured: Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 HTTP/1.1 Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7QNF3BixnwPchu4_4B3jji2GuFBlx8_hiw3VxAWcqQ_mfAOte3H6bRaZ4dFPe3zVkgE1F3LPgK7E1Qfi38Mk9c0MNagnc2UVzDcYCt8cwIrM1m_tgGy9Z77BjT7-rtadP1GVqbElX4CS9MsmCxEYoxa8gcrScnYwgKw-PS4rkM_aHM Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 85c019992192497d9832594a889da9bf Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestShelveInstance-590969834 Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:25:35.562736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/85c019992192497d9832594a889da9bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/85c019992192497d9832594a889da9bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_85c019992192497d9832594a889da9bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/85c019992192497d9832594a889da9bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestShelveInstance-590969834 Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 85c019992192497d9832594a889da9bf Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestShelveInstance-590969834 Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-TestShelveInstance-590969834-project Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 854d5db6c7f64422a946d5284570e1be Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestShelveInstance-590969834-project Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance a83d3294-0902-4f21-a7b9-45b2b5229c52 could not be found. Aug 31 19:25:35.564367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'a83d3294-0902-4f21-a7b9-45b2b5229c52'} Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83d3294-0902-4f21-a7b9-45b2b5229c52 could not be found. Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:35.565564 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83d3294-0902-4f21-a7b9-45b2b5229c52 could not be found. Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83d3294-0902-4f21-a7b9-45b2b5229c52 could not be found. Aug 31 19:25:35.567043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:25:35.568397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Returning 404 to user: Instance a83d3294-0902-4f21-a7b9-45b2b5229c52 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:35.568397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0fca355c-a246-44b3-be74-a7449a89e9b6 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52" status: 404 len: 111 microversion: 2.1 time: 0.057353 Aug 31 19:25:35.569233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 637/1231] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:35 2022] GET /compute/v2.1/servers/a83d3294-0902-4f21-a7b9-45b2b5229c52 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:35.651856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:35.654290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:35.678366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:35.680498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.681012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.681434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.682337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.682836 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.683199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.975769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e6960873-1138-4297-9d5c-96d185e13f41 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] Calling method '.version_select at 0x7f975fbd1d30>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:36.001123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:36.012533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:36.014097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:36.015185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-aa65c8a0-edd0-47e9-b36e-f29eb9243f70 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.376882 Aug 31 19:25:36.020040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e6960873-1138-4297-9d5c-96d185e13f41 tempest-TestShelveInstance-590969834 tempest-TestShelveInstance-590969834-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1723245013" status: 202 len: 0 microversion: 2.1 time: 0.051084 Aug 31 19:25:36.024765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 638/1232] 10.222.0.95 () {58 vars in 1254 bytes} [Wed Aug 31 19:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1723245013 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:36.025919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 595/1233] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:35 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:37.053595 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:37.054204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:37.069607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.070332 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.070940 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.073796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.074455 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.075097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.086379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=100 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:37.375089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.387267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.389832 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.391498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ddc7b6bc-8337-4ff6-b0b4-a8fbe5265626 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.342281 Aug 31 19:25:37.392823 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 639/1234] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:37 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:38.415595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:38.416855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:38.423974 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.424722 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.425318 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.426222 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.426835 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.427266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.710514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.720388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.722322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.723492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-550b7f24-6853-4ea5-9704-0c7a4df12f2b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.311902 Aug 31 19:25:38.726325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 596/1235] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:38 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:39.752022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:39.752901 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:39.766566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.769223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.773102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.774431 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.777907 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.778538 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:40.132720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.152583 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.154829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.156540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dbf69e2b-1fe2-4c8a-a581-a5610d65c3c5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.411764 Aug 31 19:25:40.158580 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 640/1236] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:39 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:25:41.185581 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:41.186359 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:41.194197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.194907 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.195529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.196593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.197037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.197622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.546756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.557388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.559340 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.560908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8a3addbf-0168-4eb3-b506-98782fe00d30 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.379433 Aug 31 19:25:41.572264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 597/1237] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:41 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:42.589640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:42.590242 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:42.605989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.606807 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.607492 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.609545 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.627817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.628388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.905016 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:42.915896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:42.917613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:42.919023 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4a427703-5f8a-4dfb-aa9d-c5032c9c221f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.334677 Aug 31 19:25:42.919587 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 641/1238] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:42 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:43.945965 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:43.947810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:43.957414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.958140 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.958576 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.959287 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.959804 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.960231 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.185414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.195723 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.197430 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.198719 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c4622c9e-c150-44b4-8fd8-9398149992f3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.259252 Aug 31 19:25:44.199731 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 598/1239] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:43 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:45.096706 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:45.097883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:45.105194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.106028 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.106505 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.107390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.107845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.108280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.135991 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-53fb0be8-7d52-42fc-84fb-f46582a57a1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/ips" status: 200 len: 146 microversion: 2.1 time: 0.044935 Aug 31 19:25:45.136607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 642/1240] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:25:45 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:45.224080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:45.225477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:45.234085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.235919 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.237163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.239068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.239791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.240442 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.492412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.505791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.509336 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.510622 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-42987a54-c60f-4a9d-af17-72b2fd7d03d2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.290346 Aug 31 19:25:45.512381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 599/1241] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:45 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:46.535522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:46.536722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:46.557466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.564034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.564977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.565725 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.566183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.566608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.628285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ed32b65-b58c-4a67-8dca-ebfe05ec789d"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:46.630959 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:46.637770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.638473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.638904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.639759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.640375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.641874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.834037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.849989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.851903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.853512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-edf4e8e3-1e31-457d-9da9-a9c64f97c3f1 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.322776 Aug 31 19:25:46.866104 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 643/1242] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:46 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:46.976991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6d172491-2c6e-4a73-98a5-2aa0927402e2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352921 Aug 31 19:25:46.977604 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 600/1243] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:25:46 2022] POST /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:47.878790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:47.879626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:47.888101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.889265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.890114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.892262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.893192 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.894020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.082713 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:48.091634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:48.093119 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:48.095207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-8ef3c69c-3714-4d38-95b0-00c7e02435c4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.220159 Aug 31 19:25:48.096286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 644/1244] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:47 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:49.118826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:49.119341 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:49.133733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.134391 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.135434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.136320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.143849 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.144592 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.313303 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.330210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.331654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.333116 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0c5b737b-2497-4c9d-9ad3-3bab1fbfae56 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.218813 Aug 31 19:25:49.333842 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 601/1245] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:49 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:25:50.358441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:50.359102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:50.369550 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.370349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.370997 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.371772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.372415 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.373266 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.540220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.548802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.550246 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.551441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f176769-13c1-4d69-a0cd-1c989875137e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.198723 Aug 31 19:25:50.552018 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 645/1246] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:50 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:51.582558 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:51.583176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:51.589796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.590499 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.591110 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.591818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.592268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.592717 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.835942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.847996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.849580 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.850913 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-50ded5fe-c952-45d2-b48e-38df203cdbc2 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.279376 Aug 31 19:25:51.872843 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 602/1247] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:51 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:52.879672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:52.880281 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:52.892630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.893037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.893472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:52.896751 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.897253 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.897692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:53.112604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.124224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.126493 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.127937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4150ae8b-7f04-4d94-9f47-7b500eedb85e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1744 microversion: 2.20 time: 0.252911 Aug 31 19:25:53.129574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 646/1248] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:52 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:54.152753 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.154093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:54.162402 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.163076 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.163685 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.164601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.165354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.165943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.355260 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:54.367086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:54.368667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:54.369758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b6db75d8-b3a4-4014-8632-182e0aa58feb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1744 microversion: 2.20 time: 0.221748 Aug 31 19:25:54.374597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 603/1249] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:54 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:25:54.760927 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.763925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:54.775906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.776519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.777042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.777815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.778378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.779035 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.842588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-87adb042-a1e7-4030-a576-b2e31e4c0975 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087824 Aug 31 19:25:54.855725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.856830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:54.860873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 647/1250] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:25:54 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:54.864342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.865048 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.865767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.866625 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.868029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.868645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.908386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b2216355-ab7b-4596-9388-1448c430f06d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/9ed32b65-b58c-4a67-8dca-ebfe05ec789d" status: 200 len: 194 microversion: 2.1 time: 0.057366 Aug 31 19:25:54.928190 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 604/1251] 10.222.0.95 () {58 vars in 1413 bytes} [Wed Aug 31 19:25:54 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/9ed32b65-b58c-4a67-8dca-ebfe05ec789d => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:55.399247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:55.400322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:55.413971 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.415854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.418129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.419932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.420652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.421846 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.766142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.779826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.782142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.783696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-340f8561-f8a8-46c5-a9d1-f5bb91313c8d tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.388763 Aug 31 19:25:55.784859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 648/1252] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:55 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:56.813119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:56.813695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:56.824139 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.824772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.825217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.825926 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.826771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.844418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.971937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e9e4c95-1ae1-4d9b-be2c-6d2ad55691d6"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:56.974432 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:56.998664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.999366 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.011635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.018335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.019195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.023203 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.490873 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.504242 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.505777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.513697 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4b940158-7cdd-4317-8f46-b1a9ba7b5bf5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.707752 Aug 31 19:25:57.516817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 605/1253] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:56 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:57.538889 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-2cd2ad84-cfb2-4b92-874e-7c2ed7a74525 req-3809b3a0-9d42-40b1-be78-55005c0ec06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "name": "network-vif-plugged", "status": "completed", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:57.583459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2cd2ad84-cfb2-4b92-874e-7c2ed7a74525 req-3809b3a0-9d42-40b1-be78-55005c0ec06c service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.583878 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2cd2ad84-cfb2-4b92-874e-7c2ed7a74525 req-3809b3a0-9d42-40b1-be78-55005c0ec06c service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.584302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-2cd2ad84-cfb2-4b92-874e-7c2ed7a74525 req-3809b3a0-9d42-40b1-be78-55005c0ec06c service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.622605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-53eec818-2810-4ba8-8fb2-422731e6c7b2 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "POST /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654731 Aug 31 19:25:57.644057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 649/1254] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:25:56 2022] POST /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:57.653895 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-2cd2ad84-cfb2-4b92-874e-7c2ed7a74525 req-3809b3a0-9d42-40b1-be78-55005c0ec06c service nova] Creating event network-vif-plugged:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:25:57.674420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-2cd2ad84-cfb2-4b92-874e-7c2ed7a74525 req-3809b3a0-9d42-40b1-be78-55005c0ec06c service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140755 Aug 31 19:25:57.676497 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 606/1255] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:58.548262 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:58.549563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:58.560509 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:58.567899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.568694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.569337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.570234 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.571069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.571738 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:59.000173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.014364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.025123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.026454 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7e8e0743-be49-4627-9d9d-fee1bb5ce348 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.484683 Aug 31 19:25:59.041588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 650/1256] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:58 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:00.053264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:00.054615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:00.070937 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.071747 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.072389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.073366 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.074921 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.075639 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.481812 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:00.511167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:00.516659 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:00.532047 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2d005461-bf88-41ee-9b56-d0ff86ba8d18 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.481789 Aug 31 19:26:00.549823 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 607/1257] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:00 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:01.565029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:01.566367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:01.578720 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.589624 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.590533 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.591888 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.592795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.593843 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.866738 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.877607 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.880184 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.881739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bbb556c4-f59a-4b23-9982-8f86afe11d1c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.323468 Aug 31 19:26:01.883050 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 651/1258] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:01 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:02.894326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f998e748-537c-4804-afe4-a651362fc58d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Action: 'create', calling method: .version_select at 0x7f976324d790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-266363159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwRFx0wRhApw19k3bGLvi7a9C8BajiPrA3dIC7XOdLX2AQQNmWjqJM2aBwjQW679b3YxF7VY+JyvAW2iHnKqWuIsuzT3J/vnvzBPR3+nnNKer8mal3Ylz4FrKD/CxmFDg=="}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:02.910745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:02.911686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:02.922737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.923233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.923803 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.929951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.930412 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.932776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.940086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f998e748-537c-4804-afe4-a651362fc58d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for project d5bd468566364f12abbacb3928316c78. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:26:02.951538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.quota [None req-f998e748-537c-4804-afe4-a651362fc58d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for user bc1911f5d10c4fe38b6a6c4a0950726a and project d5bd468566364f12abbacb3928316c78. Resources: {'key_pairs'} {{(pid=120707) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:26:03.020738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f998e748-537c-4804-afe4-a651362fc58d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.450813 Aug 31 19:26:03.028676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 608/1259] 10.222.0.95 () {60 vars in 1159 bytes} [Wed Aug 31 19:26:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:03.183805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.198655 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.200961 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.202411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a9cf2830-18ef-4a6a-abdb-ce0ae7fc65fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.295823 Aug 31 19:26:03.203784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 652/1260] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:02 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:04.229715 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:04.230376 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:04.238955 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.239446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.239892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.240641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.241106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.241540 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.625188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.651205 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.654070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.663735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9cf99ec5-cd78-497a-8882-d38288bd5df8 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.432672 Aug 31 19:26:04.664780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 609/1261] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:04 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:05.692423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:05.693200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:05.701243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.702008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.703319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.705290 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.706060 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.706660 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.893920 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.903414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.905358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.907423 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-dc732290-210b-4fe6-9ce0-8bbe57399926 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.219119 Aug 31 19:26:05.908610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 653/1262] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:05 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:06.869119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:06.873396 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:06.877151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:06.884890 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.885724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.886254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.887093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.887637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.888166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.893373 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:06.932045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:06.936431 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:06.946695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7e264569-02c2-4f3b-a776-cc76beb58ae8 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.089169 Aug 31 19:26:06.955771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.957030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.957567 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.958847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 610/1263] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:26:06 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:06.959662 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.960296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.961000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.109031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:07.109833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:07.122523 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.131597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.132410 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.133450 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.134142 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.134859 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.193425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-88a1ae23-a81d-4ff1-9a08-3c5897207a4d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/9ed32b65-b58c-4a67-8dca-ebfe05ec789d" status: 200 len: 194 microversion: 2.1 time: 0.078971 Aug 31 19:26:07.194406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 611/1264] 10.222.0.95 () {58 vars in 1413 bytes} [Wed Aug 31 19:26:07 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/9ed32b65-b58c-4a67-8dca-ebfe05ec789d => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:07.211764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:07.213512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:07.214743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:07.222818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:07.224277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.224989 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.225615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.226650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.227534 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.228151 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.251383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:07.257165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:07.262357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-37680a40-6e7a-49e3-956d-f3911d4702fb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.333955 Aug 31 19:26:07.263809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 654/1265] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:06 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:07.389336 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'services' on Instance uuid 044adca5-daa1-4ff7-b516-0847e618d6c7 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:07.521100 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4451c019-a5f1-4b52-a4f8-951cb2c45aaf tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/9ed32b65-b58c-4a67-8dca-ebfe05ec789d" status: 202 len: 0 microversion: 2.1 time: 0.315690 Aug 31 19:26:07.537293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 612/1266] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:26:07 2022] DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/9ed32b65-b58c-4a67-8dca-ebfe05ec789d => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:26:08.297024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:08.297994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:08.320861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.321479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.322247 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.323186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.323765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.324317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.529207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.539730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.541330 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.543023 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-06782f03-1aa6-467d-a86d-622a20974bd0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.253210 Aug 31 19:26:08.544072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 655/1267] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:08 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:09.578533 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.580756 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.594550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.595079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.595507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.596214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.596808 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.597522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.845624 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.855767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.859546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.860975 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ec679b7e-7e4c-4b29-b3f9-acc1da3edb96 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.295699 Aug 31 19:26:09.868349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.869125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.872901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 613/1268] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:09 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:09.900418 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.904930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.905391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.908710 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.910211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.916517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.956558 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-69fed562-1065-40cb-b2f5-17c4ad1d7fea tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/0e9e4c95-1ae1-4d9b-be2c-6d2ad55691d6" status: 200 len: 194 microversion: 2.1 time: 0.092032 Aug 31 19:26:09.957971 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 656/1269] 10.222.0.95 () {58 vars in 1413 bytes} [Wed Aug 31 19:26:09 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/0e9e4c95-1ae1-4d9b-be2c-6d2ad55691d6 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:09.969811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.970306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.978002 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.978488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.987449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.988218 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.989057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.989274 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.145265 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'services' on Instance uuid 044adca5-daa1-4ff7-b516-0847e618d6c7 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:10.255845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4f2f46e7-ffb8-4202-aecc-50ecd318a2ae tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/0e9e4c95-1ae1-4d9b-be2c-6d2ad55691d6" status: 202 len: 0 microversion: 2.1 time: 0.290668 Aug 31 19:26:10.256714 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 614/1270] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:26:09 2022] DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments/0e9e4c95-1ae1-4d9b-be2c-6d2ad55691d6 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:26:10.895282 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:10.900015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:10.912007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.915541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.916255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.925557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.926490 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.927252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:11.115044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.147548 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.153604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.155137 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4c9d6cc1-40c4-47f6-8442-da77de92517b tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1739 microversion: 2.20 time: 0.274178 Aug 31 19:26:11.163521 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 657/1271] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:10 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:12.188256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.189078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.196108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.196544 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.197000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.197734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.198189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.198613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.366634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:12.376288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:12.377780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:12.378928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-3b460ef3-5602-4ac0-b6d4-ac06d70fb197 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1721 microversion: 2.20 time: 0.195807 Aug 31 19:26:12.379500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 615/1272] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:12.519472 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.521917 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.529000 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.529481 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.529938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.530681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.532314 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.532785 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.564268 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0a43b0c7-1ca8-40f2-92d6-04a1882f014d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050054 Aug 31 19:26:12.565048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 658/1273] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:26:12.683458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.685855 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.692486 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.693091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.693587 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.694339 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.694850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.695332 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.731647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-79ce3104-7fe2-43f9-bd73-2ec021807742 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052510 Aug 31 19:26:12.732226 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 616/1274] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:26:12.806504 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.807026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.814982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.815520 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.815965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.816726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.817181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.817603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.848488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:26:12.955515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7ad239e9-3301-4238-9416-25fbf51d287c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 204 len: 0 microversion: 2.1 time: 0.152740 Aug 31 19:26:12.956258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 659/1275] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:12 2022] DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:12.964456 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.965091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.972192 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.972720 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.973152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.973860 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.974311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.974733 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.975299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:13.122543 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.132189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-266edd5b-6468-4c47-b17b-1a477f9b2515 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1672 microversion: 2.1 time: 0.171669 Aug 31 19:26:13.132886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 617/1276] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:13.403433 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:13.404043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:13.411183 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.411697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.412131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.412938 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.413388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.413813 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.444086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:13.444770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:13.451050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.451539 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.451962 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.452954 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.453458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.453845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.479431 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2a6af33-b7da-4cd9-a60a-8253b09d42da tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/ips" status: 200 len: 149 microversion: 2.1 time: 0.039078 Aug 31 19:26:13.480017 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 618/1277] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:26:13 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:13.569530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.580280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.581771 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.582928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-aab34a30-1eeb-4368-bafe-0a672d643b32 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1721 microversion: 2.20 time: 0.184047 Aug 31 19:26:13.583487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 660/1278] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:13 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:14.154764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:14.155378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.162438 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.162918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.163354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.164043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.164495 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.164945 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.299755 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.308009 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8a00f19d-fa96-4548-93ff-e98da568ee8b tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1672 microversion: 2.1 time: 0.157259 Aug 31 19:26:14.308585 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 619/1279] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:14 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:14.605708 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:14.606344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.613275 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.613754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.614186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.614877 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.615326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.615778 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.751557 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.759599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.761059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.762202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-18a3c318-1786-4117-a8f0-b2d88f258250 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1721 microversion: 2.20 time: 0.160422 Aug 31 19:26:14.762750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 661/1280] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:14 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:14.872648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b71260e-a8c2-4e32-8c49-817b938e16f0"}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:14.875606 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.881915 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.882389 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.882811 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.883492 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.883935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.884347 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.150757 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-ea05212f-7b60-4e3b-84df-95cafa2fa258 req-fd15dae4-0b94-4a86-b0bf-053be9e2194e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "name": "network-vif-unplugged", "status": "completed", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:15.173020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-ea05212f-7b60-4e3b-84df-95cafa2fa258 req-fd15dae4-0b94-4a86-b0bf-053be9e2194e service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.174299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-ea05212f-7b60-4e3b-84df-95cafa2fa258 req-fd15dae4-0b94-4a86-b0bf-053be9e2194e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.175338 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-ea05212f-7b60-4e3b-84df-95cafa2fa258 req-fd15dae4-0b94-4a86-b0bf-053be9e2194e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.199576 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-ea05212f-7b60-4e3b-84df-95cafa2fa258 req-fd15dae4-0b94-4a86-b0bf-053be9e2194e service nova] Creating event network-vif-unplugged:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:26:15.205603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-ea05212f-7b60-4e3b-84df-95cafa2fa258 req-fd15dae4-0b94-4a86-b0bf-053be9e2194e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072226 Aug 31 19:26:15.207207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 662/1281] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:15.331915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:15.332636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:15.338956 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.339500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.340038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.341339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.341752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.342214 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.476985 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.486941 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bbbe4b05-3db8-4bcb-89d3-5911d871f017 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1672 microversion: 2.1 time: 0.159715 Aug 31 19:26:15.487522 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 663/1282] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:15 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:15.786697 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:15.787378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:15.794190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.794668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.795105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.795800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.796276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.796744 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.937950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.946217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.947667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.948851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-07661baf-a125-4019-a3b6-e558e47436fc tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1721 microversion: 2.20 time: 0.166235 Aug 31 19:26:15.949408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 664/1283] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:15 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:16.508440 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.509087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.515911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.516157 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.516540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.517252 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.517695 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.518111 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.649318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:16.658658 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3339e739-3724-4f74-9149-0845e141fd1c tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1672 microversion: 2.1 time: 0.153951 Aug 31 19:26:16.659470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 665/1284] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:16.973613 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.974388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.981577 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.982088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.982523 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.983241 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.983686 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.984427 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.117982 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.127480 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.128447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.129650 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c4a36a84-74e6-4bdb-a43c-53494cbc72e5 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1721 microversion: 2.20 time: 0.160379 Aug 31 19:26:17.130357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 666/1285] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:17.680007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:17.680597 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:17.687174 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.688646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.689097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.689795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.690244 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.690667 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.830291 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.837901 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6189f698-cb40-49f2-b666-a39ca16bff80 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1672 microversion: 2.1 time: 0.161886 Aug 31 19:26:17.838471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 667/1286] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:17 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:18.153948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:18.154547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.162617 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.163137 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.163535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.164475 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.165076 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.165357 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.354283 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4daa571c-faf0-4ab0-9196-5382f6405de4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "POST /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.485389 Aug 31 19:26:18.355902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 620/1287] 10.222.0.95 () {60 vars in 1323 bytes} [Wed Aug 31 19:26:14 2022] POST /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments => generated 194 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:18.397896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.408581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.413744 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.415067 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d7dcb1d5-e480-4fa3-a37d-019cd37c343e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1721 microversion: 2.20 time: 0.265684 Aug 31 19:26:18.415634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 668/1288] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:18 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:18.865952 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:18.866928 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.881275 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.882144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.883165 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.885095 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.886285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.887284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.963106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.973026 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a4caae93-e347-4b29-a787-d090528171ec tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1604 microversion: 2.1 time: 0.115978 Aug 31 19:26:18.973801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 621/1289] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:18 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1604 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:19.207447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-7b7b5395-94d1-4c61-89a6-52ad1359362a req-815a966f-2c98-48cd-858e-64bfad38c3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "044adca5-daa1-4ff7-b516-0847e618d6c7", "name": "network-vif-deleted", "tag": "19b37898-88f3-4cfc-b64d-3ea8beb12ae3"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:19.219603 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7b7b5395-94d1-4c61-89a6-52ad1359362a req-815a966f-2c98-48cd-858e-64bfad38c3d5 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.220080 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7b7b5395-94d1-4c61-89a6-52ad1359362a req-815a966f-2c98-48cd-858e-64bfad38c3d5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.220510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-7b7b5395-94d1-4c61-89a6-52ad1359362a req-815a966f-2c98-48cd-858e-64bfad38c3d5 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.234800 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-7b7b5395-94d1-4c61-89a6-52ad1359362a req-815a966f-2c98-48cd-858e-64bfad38c3d5 service nova] Creating event network-vif-deleted:19b37898-88f3-4cfc-b64d-3ea8beb12ae3 for instance 044adca5-daa1-4ff7-b516-0847e618d6c7 on hv-cinder-85221 Aug 31 19:26:19.240687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-7b7b5395-94d1-4c61-89a6-52ad1359362a req-815a966f-2c98-48cd-858e-64bfad38c3d5 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037592 Aug 31 19:26:19.244930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 669/1290] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:19.440383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:19.441031 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:19.447642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.448358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.449258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.450513 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.451188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.451854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.646185 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:19.654405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:19.658041 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:19.660170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-35ac5ec1-901b-441a-9103-c560e6c1ddcd tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1664 microversion: 2.20 time: 0.225201 Aug 31 19:26:19.672597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 622/1291] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:19 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1664 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:19.684019 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51e203d0-7d7d-4b4f-be44-db639c28ae42"}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:19.686659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:19.693347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.693835 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.694274 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.694983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.695435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.695865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.784043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:19.995530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:19.996643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.005708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.006471 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.007159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.008310 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.009170 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.010565 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.035692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e2f6f8b9-f915-4d0d-9f4a-014bfaa4a44c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.355888 Aug 31 19:26:20.036811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 670/1292] 10.222.0.95 () {62 vars in 1364 bytes} [Wed Aug 31 19:26:19 2022] POST /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-volume_attachments => generated 188 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:26:20.215854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.216891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.217491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.219473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.objects.instance [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lazy-loading 'fault' on Instance uuid 044adca5-daa1-4ff7-b516-0847e618d6c7 {{(pid=120707) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:20.240904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:20.242201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.251622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.252322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.253223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.254335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.255287 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.256121 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.270225 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a288c513afd94adaa9f53f9f65dc9dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e607dfc7e4b089c7e744f4b1059e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.279153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-28526df2-50b0-4b0d-9703-d8ab3540557d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 200 len: 1325 microversion: 2.1 time: 0.288693 Aug 31 19:26:20.280327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 623/1293] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:19 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:20.552270 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ee8ebe10-2676-4677-8378-c21673f1312e tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-volume_attachments/51e203d0-7d7d-4b4f-be44-db639c28ae42" status: 202 len: 0 microversion: 2.20 time: 0.315246 Aug 31 19:26:20.553249 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 671/1294] 10.222.0.95 () {60 vars in 1457 bytes} [Wed Aug 31 19:26:20 2022] DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-volume_attachments/51e203d0-7d7d-4b4f-be44-db639c28ae42 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:20.619597 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:20.620236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.627256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.627815 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.628289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.629024 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.629478 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.629902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.632404 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:20.676857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120707) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:26:20.747461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5e7f9131-3d12-4a26-942a-32f48c298551 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "POST /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/action" status: 202 len: 0 microversion: 2.20 time: 0.131798 Aug 31 19:26:20.748493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 624/1295] 10.222.0.95 () {62 vars in 1319 bytes} [Wed Aug 31 19:26:20 2022] POST /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:20.760740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:20.761689 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.769216 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.770405 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.771066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.772192 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.772902 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.773388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.933337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.942984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.944842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.946037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-95b746d1-6bc2-4596-b666-10567cb05c83 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1672 microversion: 2.20 time: 0.192427 Aug 31 19:26:20.946604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 672/1296] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:20 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:21.303885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.304417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.311163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.312699 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.312996 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.314128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.314721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.314998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.330998 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] HTTP exception thrown: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Request method failure captured: Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 HTTP/1.1 Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbY-IJlu5VoYN-4dCLdGkHDJ1NZUQPBhqiXn15Aj6j9mmx256MoamKybc0khNyF3YGYz6ATFb8lnReyx0XfrcDHg_f1lMN1-pca-bmFfKZkUFxs6LhEbRWwb9fZShW8UpxLt9OSmZwTbxjSKGyhFsEV1XxgSsbJkCIYuJ7g_eXN_E Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:21.332704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: a288c513afd94adaa9f53f9f65dc9dd8 Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:21.334637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '044adca5-daa1-4ff7-b516-0847e618d6c7'} Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:21.335995 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:21.338276 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:21.340014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Returning 404 to user: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:21.340014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2dc3c151-f522-4940-9da7-9055d0d2382a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 404 len: 111 microversion: 2.1 time: 0.035216 Aug 31 19:26:21.340014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 625/1297] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:21.343929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f3e3d32e-7a01-4a87-b6c9-23a41743cd00 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '.version_select at 0x7f975fb3a670>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.366876 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f3e3d32e-7a01-4a87-b6c9-23a41743cd00 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759537644" status: 202 len: 0 microversion: 2.1 time: 0.027053 Aug 31 19:26:21.367466 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 673/1298] 10.222.0.95 () {58 vars in 1218 bytes} [Wed Aug 31 19:26:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759537644 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:26:21.972112 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.973392 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.984875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.985375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.985856 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.987559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.988099 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.988623 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.159760 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.168458 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.169938 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.171696 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5d7dca64-df25-4ca1-b71f-cb3e92106f3a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.204268 Aug 31 19:26:22.172445 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 626/1299] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:23.195618 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:23.196283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:23.203664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.204156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.204621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.205333 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.205792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.206479 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.408058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.422865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.425172 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.426688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-77d6b867-0810-453e-9b58-60c06095e4f4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.236039 Aug 31 19:26:23.427474 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 674/1300] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:23 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:24.457902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.458742 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.466578 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.467532 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.469073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.469997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.470636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.471431 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.502759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.503358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.511383 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.511895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.512310 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.513045 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.514915 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.515949 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.548879 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] HTTP exception thrown: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Request method failure captured: Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 HTTP/1.1 Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbY-IJlu5VoYN-4dCLdGkHDJ1NZUQPBhqiXn15Aj6j9mmx256MoamKybc0khNyF3YGYz6ATFb8lnReyx0XfrcDHg_f1lMN1-pca-bmFfKZkUFxs6LhEbRWwb9fZShW8UpxLt9OSmZwTbxjSKGyhFsEV1XxgSsbJkCIYuJ7g_eXN_E Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:24.552211 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: a288c513afd94adaa9f53f9f65dc9dd8 Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.554093 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '044adca5-daa1-4ff7-b516-0847e618d6c7'} Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:24.554895 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.556311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.559541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Returning 404 to user: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:24.562446 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-67442df3-79a3-40f6-9d11-298249404c2a tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 404 len: 111 microversion: 2.1 time: 0.063972 Aug 31 19:26:24.563222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 675/1301] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:24 2022] DELETE /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:24.574342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.576379 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 044adca5-daa1-4ff7-b516-0847e618d6c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.588828 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.590297 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.593937 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.594996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.596629 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.598097 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.630453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] HTTP exception thrown: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Request method failure captured: Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 HTTP/1.1 Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbY-IJlu5VoYN-4dCLdGkHDJ1NZUQPBhqiXn15Aj6j9mmx256MoamKybc0khNyF3YGYz6ATFb8lnReyx0XfrcDHg_f1lMN1-pca-bmFfKZkUFxs6LhEbRWwb9fZShW8UpxLt9OSmZwTbxjSKGyhFsEV1XxgSsbJkCIYuJ7g_eXN_E Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:24.632024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: a288c513afd94adaa9f53f9f65dc9dd8 Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.633429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '044adca5-daa1-4ff7-b516-0847e618d6c7'} Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:24.634653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. Aug 31 19:26:24.636347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:24.642411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Returning 404 to user: Instance 044adca5-daa1-4ff7-b516-0847e618d6c7 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:24.642411 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-418ccb2c-ca3c-4b3e-94df-3ba295eed30d tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7" status: 404 len: 111 microversion: 2.1 time: 0.069285 Aug 31 19:26:24.643087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 676/1302] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:24 2022] GET /compute/v2.1/servers/044adca5-daa1-4ff7-b516-0847e618d6c7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:24.715086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.739439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.741289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.742702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e482c394-de21-49b9-8480-c5fb376adb02 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.295417 Aug 31 19:26:24.757681 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 627/1303] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:24 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:25.774715 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.776861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.786185 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.786738 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.787429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.788452 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.789202 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.790029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.923939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.925187 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.931910 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.933183 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.933896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.935012 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.935741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.945941 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.970473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] HTTP exception thrown: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Request method failure captured: Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 HTTP/1.1 Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbY-IJlu5VoYN-4dCLdGkHDJ1NZUQPBhqiXn15Aj6j9mmx256MoamKybc0khNyF3YGYz6ATFb8lnReyx0XfrcDHg_f1lMN1-pca-bmFfKZkUFxs6LhEbRWwb9fZShW8UpxLt9OSmZwTbxjSKGyhFsEV1XxgSsbJkCIYuJ7g_eXN_E Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:25.972245 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: a288c513afd94adaa9f53f9f65dc9dd8 Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:25.973867 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '4e955cd6-de98-48e5-90af-020d4952bc40'} Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:25.974800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:25.976278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:25.978796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Returning 404 to user: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:25.979933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2727c30c-85b8-4c85-98fd-a8abb2744c53 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 404 len: 111 microversion: 2.1 time: 0.064903 Aug 31 19:26:25.980770 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 628/1304] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:25 2022] DELETE /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:25.995944 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.997038 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] [instance: 4e955cd6-de98-48e5-90af-020d4952bc40] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:26.012935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:26.013652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:26.014345 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.016123 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:26.016789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:26.017212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.041172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] HTTP exception thrown: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Request method failure captured: Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 HTTP/1.1 Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbY-IJlu5VoYN-4dCLdGkHDJ1NZUQPBhqiXn15Aj6j9mmx256MoamKybc0khNyF3YGYz6ATFb8lnReyx0XfrcDHg_f1lMN1-pca-bmFfKZkUFxs6LhEbRWwb9fZShW8UpxLt9OSmZwTbxjSKGyhFsEV1XxgSsbJkCIYuJ7g_eXN_E Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:26.042946 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/6d1e607dfc7e4b089c7e744f4b1059e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 6d1e607dfc7e4b089c7e744f4b1059e8 Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1710181407 Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: a288c513afd94adaa9f53f9f65dc9dd8 Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeTestJSON-1710181407-project Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:26.045464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '4e955cd6-de98-48e5-90af-020d4952bc40'} Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:26.047777 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. Aug 31 19:26:26.049300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:26.050721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] Returning 404 to user: Instance 4e955cd6-de98-48e5-90af-020d4952bc40 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:26.050721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-63db9ce9-df7d-47dc-8bbe-86dc80262702 tempest-AttachVolumeTestJSON-1710181407 tempest-AttachVolumeTestJSON-1710181407-project] 10.222.0.95 "GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40" status: 404 len: 111 microversion: 2.1 time: 0.053665 Aug 31 19:26:26.050721 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 629/1305] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/4e955cd6-de98-48e5-90af-020d4952bc40 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:26.051001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.060636 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.062857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.063821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-15b0a683-d568-4446-aa57-4ba39e22f267 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.293591 Aug 31 19:26:26.064372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 677/1306] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:27.094163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:27.094943 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:27.128371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.129172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.129800 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.130960 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.131666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.132278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.375213 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.401398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.403295 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.404502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c39375d1-edf7-416e-aa9e-579a48223951 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.318607 Aug 31 19:26:27.421613 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 630/1307] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:27 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:28.435010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:28.435718 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:28.456806 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.457706 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.458385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.459500 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.460224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.460936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.466776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.480336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.485769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.491010 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a7f4ea62-4bb1-49f2-9b5d-30c42a6940d0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 1.063709 Aug 31 19:26:29.492006 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 678/1308] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:28 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:30.518690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:30.519508 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:30.537472 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.539120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.540080 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.541368 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.543136 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.544784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.874658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.900682 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.902477 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.903981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-74650a99-5927-4e72-9454-3f3bf9a58e06 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.390517 Aug 31 19:26:30.905832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 631/1309] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:30 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:31.931441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:31.932146 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:31.934200 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:31.995072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.005167 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.007036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.008038 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.010989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.015307 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.254784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.272402 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.275391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.277180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0b86175a-8ea8-4974-a230-5472fde37e92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.350498 Aug 31 19:26:32.278661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 679/1310] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:31 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:33.307109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:33.307780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:33.315744 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.316268 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.316958 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.317610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.318067 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.318488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.468214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.478234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.479666 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.480845 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-31158730-1a54-4d93-b674-482601a796c0 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.177511 Aug 31 19:26:33.481559 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 632/1311] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:33 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:34.504866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:34.506015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:34.514736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.515574 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.516208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.516943 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.517566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.517995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.662335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.671542 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.673102 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.674745 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5a64ed32-539f-4f95-b392-cf21db04a4e3 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.173918 Aug 31 19:26:34.675390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 680/1312] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:34 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:35.704711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:35.706403 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.714862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.715863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.716706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.717725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.718784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.719516 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.964939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.979706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.985219 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.986628 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8736e217-bdcc-451e-a7b1-823f4e98ae92 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.290061 Aug 31 19:26:36.015693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 633/1313] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:35 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:36.178515 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:36.179101 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:36.185532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.186090 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.187716 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.188434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.188914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.189343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.297911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'services' on Instance uuid efd38835-5c39-470d-91d3-9bf5b47b2fec {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:36.387776 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c0317860-fa6b-4e86-959b-e7ffc19fa0db tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments/1b71260e-a8c2-4e32-8c49-817b938e16f0" status: 202 len: 0 microversion: 2.1 time: 0.212984 Aug 31 19:26:36.389809 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 681/1314] 10.222.0.95 () {58 vars in 1416 bytes} [Wed Aug 31 19:26:36 2022] DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments/1b71260e-a8c2-4e32-8c49-817b938e16f0 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:26:36.403682 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:36.407357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:36.415737 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.416900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.417574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.419199 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.420236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.420923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.457724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a234a773-7953-457a-8ede-2e2a42dd613c tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063010 Aug 31 19:26:36.459197 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 634/1315] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:26:36 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:37.021243 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:37.022526 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:37.032229 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.033664 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.034408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.035856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.036786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.037703 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.209465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.220224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.222682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.223965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-87f741b1-2ceb-4900-9066-ff99778fbfda tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.212230 Aug 31 19:26:37.225022 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 682/1316] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:37 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:37.471984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:37.474549 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:37.480988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:37.486352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.487156 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.487653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.488886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.489560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.490194 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.530608 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7fa591cf-8bdc-4862-947d-d6eac7e046b0 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064205 Aug 31 19:26:37.533028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 635/1317] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:26:37 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:38.180970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-368778423", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-266363159", "security_groups": [{"name": "tempest-secgroup-smoke-438942654"}], "block_device_mapping_v2": [{"uuid": "ae3c8e7d-c2ae-420d-9d40-844505d3b574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d49a59f8-0818-4aaa-809c-d0ae00d3fb2d"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:38.253169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.254180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.261461 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.261964 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.262388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.263398 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.263854 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.265084 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.311177 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] validate_networks() for [('d49a59f8-0818-4aaa-809c-d0ae00d3fb2d', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:26:38.555657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.566821 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.568520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.570252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4a7bde43-4c33-4b8c-8829-194c607d0d8c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.322891 Aug 31 19:26:38.570897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 636/1318] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:38.576377 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.579381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.585892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.586683 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.587214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.588163 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.588969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.589652 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.631553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-6168274c-6ce6-4eaa-b439-fdc19888d1e8 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059306 Aug 31 19:26:38.632129 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 637/1319] 10.222.0.95 () {58 vars in 1302 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:26:38.713764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.714457 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.722164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.722903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.723436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.724330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.724934 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.725453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.755057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:26:38.853143 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-694a5c7e-d6af-4e3e-bc3a-f758d7941476 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 204 len: 0 microversion: 2.1 time: 0.144091 Aug 31 19:26:38.854200 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 638/1320] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:38 2022] DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:26:38.866647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.868044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.876155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:26:38.876802 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:26:38.877348 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.877484 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:26:38.877838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.877972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:26:38.878283 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:26:38.878550 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.885443 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.885934 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.886378 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.888301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.889784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.890622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.891541 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.892005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.892468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.910958 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for project d5bd468566364f12abbacb3928316c78. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:26:38.915220 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for user bc1911f5d10c4fe38b6a6c4a0950726a and project d5bd468566364f12abbacb3928316c78. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:26:38.986226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:26:38.988851 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae3c8e7d-c2ae-420d-9d40-844505d3b574',volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:26:39.038420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.048473 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-187a18b4-d001-4aca-b6ac-16d71f234667 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1680 microversion: 2.1 time: 0.188065 Aug 31 19:26:39.049615 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 639/1321] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:39.148546 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5407bebd-c776-4fb4-8b60-dc59e2c54e8b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.970870 Aug 31 19:26:39.152732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 683/1322] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:26:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:26:39.160285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-181200fc-6ee2-44fd-a379-b373fa45114e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:39.160921 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-181200fc-6ee2-44fd-a379-b373fa45114e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:39.225754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-181200fc-6ee2-44fd-a379-b373fa45114e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.234832 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-181200fc-6ee2-44fd-a379-b373fa45114e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1093 microversion: 2.1 time: 0.078676 Aug 31 19:26:39.236446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 640/1323] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:39 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:39.378579 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-e5c6bef3-f2bd-4594-ab33-ae362067b87f req-b1d42d62-69f0-450b-94df-37ccaa2b4eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "name": "network-vif-plugged", "status": "completed", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:39.391036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e5c6bef3-f2bd-4594-ab33-ae362067b87f req-b1d42d62-69f0-450b-94df-37ccaa2b4eda service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.391189 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e5c6bef3-f2bd-4594-ab33-ae362067b87f req-b1d42d62-69f0-450b-94df-37ccaa2b4eda service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.391627 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-e5c6bef3-f2bd-4594-ab33-ae362067b87f req-b1d42d62-69f0-450b-94df-37ccaa2b4eda service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.403858 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-e5c6bef3-f2bd-4594-ab33-ae362067b87f req-b1d42d62-69f0-450b-94df-37ccaa2b4eda service nova] Creating event network-vif-plugged:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:26:39.409726 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-e5c6bef3-f2bd-4594-ab33-ae362067b87f req-b1d42d62-69f0-450b-94df-37ccaa2b4eda service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035852 Aug 31 19:26:39.410622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 684/1324] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:39.596663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:39.597852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:39.606119 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.606933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.607588 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.608902 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.609863 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.610923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.634904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:39.759419 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.769099 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.770522 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.771704 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8162486d-067c-42b5-9c71-7ac7b4b0fca4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.180188 Aug 31 19:26:39.772621 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 641/1325] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:39 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:40.072224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.073123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.079866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.080420 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.080881 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.081765 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.082358 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.082834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.101204 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:INSERT=6,nova_cell1:SELECT=86,nova_cell1:UPDATE=8 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:40.224006 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.231984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-34e0577f-2ccd-456b-bb0c-26bf4624400b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1680 microversion: 2.1 time: 0.164140 Aug 31 19:26:40.232639 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 685/1326] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:40.257338 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.258177 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.264489 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.265138 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.265487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.266186 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.266637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.267063 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.329775 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.337813 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4fd769d8-1650-4e9d-bf90-da940b5a0c5b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1143 microversion: 2.1 time: 0.084238 Aug 31 19:26:40.338498 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 642/1327] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:40.795446 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.796064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.802539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.803015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.803449 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.804134 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.804598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.805263 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.946450 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.958530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.960468 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.962376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb89efa1-bd4d-4673-a4ad-7426fd1f2b23 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.170860 Aug 31 19:26:40.963670 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 686/1328] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:41.254590 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:41.255932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:41.269280 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.270223 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.270827 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.271711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.273386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.273876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.361669 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:41.362625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:41.370298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.371005 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.371788 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.372897 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.373796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.375258 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.462155 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:41.472680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e6ab0aa8-ae4c-47ae-a7da-efc399bad4d4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1191 microversion: 2.1 time: 0.116503 Aug 31 19:26:41.473912 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 687/1329] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:41 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:41.505658 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:41.514135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c0ce13f5-2e33-4db0-9683-8bd0015c9a73 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1680 microversion: 2.1 time: 0.264233 Aug 31 19:26:41.515792 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 643/1330] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:41 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:41.992537 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:41.993630 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:42.003885 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.004535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.005091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.005952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.006498 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.007154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.204285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-16ab6590-5773-4e1d-9af8-526c2586e0c6 req-8b29b17c-4f82-456b-af82-6e653e5e8267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd38835-5c39-470d-91d3-9bf5b47b2fec", "name": "network-vif-deleted", "tag": "a7aeda1c-033f-4630-9e3d-cee6e7a973ff"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:42.212644 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.216918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-16ab6590-5773-4e1d-9af8-526c2586e0c6 req-8b29b17c-4f82-456b-af82-6e653e5e8267 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.217801 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-16ab6590-5773-4e1d-9af8-526c2586e0c6 req-8b29b17c-4f82-456b-af82-6e653e5e8267 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.219220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-16ab6590-5773-4e1d-9af8-526c2586e0c6 req-8b29b17c-4f82-456b-af82-6e653e5e8267 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.223228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.225653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.226873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bfd1ac53-c0b9-417b-9ad6-15fe12afae97 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.243513 Aug 31 19:26:42.227816 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 688/1331] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:41 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:42.239672 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-16ab6590-5773-4e1d-9af8-526c2586e0c6 req-8b29b17c-4f82-456b-af82-6e653e5e8267 service nova] Creating event network-vif-deleted:a7aeda1c-033f-4630-9e3d-cee6e7a973ff for instance efd38835-5c39-470d-91d3-9bf5b47b2fec on hv-cinder-85221 Aug 31 19:26:42.245531 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-16ab6590-5773-4e1d-9af8-526c2586e0c6 req-8b29b17c-4f82-456b-af82-6e653e5e8267 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045971 Aug 31 19:26:42.247240 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 644/1332] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:42.495808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:42.496681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:42.508170 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.512122 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.512857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.521704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.522470 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.526298 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.537293 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:42.538050 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:42.550292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.550772 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.551203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.551894 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.559256 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.560168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.646091 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.662120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6f54281f-29dc-4cff-9566-2ff81ea55f81 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1209 microversion: 2.1 time: 0.170521 Aug 31 19:26:42.668442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 689/1333] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:42 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1209 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:42.701899 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.712172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-7069cb58-210d-48e4-99fe-20fcc97055d4 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1326 microversion: 2.1 time: 0.179782 Aug 31 19:26:42.724903 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 645/1334] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:42 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1326 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:43.255948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:43.258316 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:43.266724 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.267646 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.268159 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.268919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.269372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.269787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.497421 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.511749 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.516232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.522641 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c937bc89-4a5a-497b-84e1-7b5737c2f705 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1730 microversion: 2.20 time: 0.274370 Aug 31 19:26:43.526549 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 690/1335] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:43 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:43.691634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:43.692901 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:43.699500 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.699988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.700439 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.701353 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.701640 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.707555 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.742118 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:43.745487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:43.766935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.767510 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.767953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.769540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.770186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.773388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.800868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.809507 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4ef0b27e-f177-4167-9e11-b4361deef5c2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1209 microversion: 2.1 time: 0.126263 Aug 31 19:26:43.815327 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.816312 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.817055 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.818236 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lazy-loading 'fault' on Instance uuid efd38835-5c39-470d-91d3-9bf5b47b2fec {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:43.821236 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 646/1336] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:43 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:43.866652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e09978ed8b3490db5f92823768f1d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb8f75600714e23bda1c8886bdb22f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.876105 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4d104a4a-61b7-42b8-846e-552e2e0421ea tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 200 len: 1331 microversion: 2.1 time: 0.139562 Aug 31 19:26:43.876739 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 691/1337] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:43 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:44.551249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:44.552014 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:44.558650 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.559885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.560600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.561885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.562545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.563814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.786412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:44.796900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:44.798383 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:44.799556 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-032f34ce-c04e-4e77-9bbc-4d55acdfbf91 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1717 microversion: 2.20 time: 0.255479 Aug 31 19:26:44.800107 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 647/1338] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:44 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1717 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:44.832089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:44.832919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:44.839318 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.839792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.840222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.840934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.841384 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.841848 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.900051 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:44.900897 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:44.908991 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.909716 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.910331 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.911046 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.911545 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.912326 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.942029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec HTTP/1.1 Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:44.943999 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:44.945858 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'efd38835-5c39-470d-91d3-9bf5b47b2fec'} Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:44.947055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:44.948791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:44.951754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:44.953399 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-949bf135-f251-4610-8744-ac534162a70f tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 404 len: 111 microversion: 2.1 time: 0.057461 Aug 31 19:26:44.954152 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 648/1339] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:44 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:26:44.961078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-b8fb897a-d1d8-4120-9fc5-0fa09d66c6b9 req-11929af2-3f5f-4ab1-9bd5-c91bbfe9d100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535c47a4-fdfe-43c6-bb6e-76be6785b3df", "tag": "752b4a4f-7bac-4f69-adca-ca246584df96"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:44.976984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b8fb897a-d1d8-4120-9fc5-0fa09d66c6b9 req-11929af2-3f5f-4ab1-9bd5-c91bbfe9d100 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.977501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b8fb897a-d1d8-4120-9fc5-0fa09d66c6b9 req-11929af2-3f5f-4ab1-9bd5-c91bbfe9d100 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.977935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-b8fb897a-d1d8-4120-9fc5-0fa09d66c6b9 req-11929af2-3f5f-4ab1-9bd5-c91bbfe9d100 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.991633 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-b8fb897a-d1d8-4120-9fc5-0fa09d66c6b9 req-11929af2-3f5f-4ab1-9bd5-c91bbfe9d100 service nova] Creating event network-changed:752b4a4f-7bac-4f69-adca-ca246584df96 for instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df on hv-cinder-85221 Aug 31 19:26:44.996105 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-b8fb897a-d1d8-4120-9fc5-0fa09d66c6b9 req-11929af2-3f5f-4ab1-9bd5-c91bbfe9d100 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040681 Aug 31 19:26:44.996276 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:44.996727 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 649/1340] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:45.004465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cbe74018-b790-431d-bc21-62a536151226 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.176729 Aug 31 19:26:45.004909 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5de18da4-dc7b-4464-96ac-d72e6b3562ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '.version_select at 0x7f97632d6670>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:45.008962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 692/1341] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:44 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:45.035807 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5de18da4-dc7b-4464-96ac-d72e6b3562ec tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248211101" status: 202 len: 0 microversion: 2.1 time: 0.035024 Aug 31 19:26:45.036381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 650/1342] 10.222.0.95 () {58 vars in 1218 bytes} [Wed Aug 31 19:26:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248211101 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:26:46.033072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:46.033072 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:46.037286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.037847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.038372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.039158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.039681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.040176 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.206538 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:46.214728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-28962f02-fed1-43fe-9892-185ae84e1f3a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.191130 Aug 31 19:26:46.215395 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 693/1343] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:46 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:46.863171 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:46.863834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:46.870695 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.871168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.871595 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.872280 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.872764 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.873184 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.886758 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec HTTP/1.1 Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:46.888397 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.890087 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'efd38835-5c39-470d-91d3-9bf5b47b2fec'} Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:46.891113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.892417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.894290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:46.894290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-21172caa-535b-4143-97b9-cc17544c3351 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 404 len: 111 microversion: 2.1 time: 0.031238 Aug 31 19:26:46.894290 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 651/1344] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:46 2022] DELETE /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:46.898611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:46.899240 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: efd38835-5c39-470d-91d3-9bf5b47b2fec] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:46.906160 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.906647 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.907196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.907892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:46.908349 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:46.908859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.922608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec HTTP/1.1 Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:46.924228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.926973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'efd38835-5c39-470d-91d3-9bf5b47b2fec'} Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:46.928388 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. Aug 31 19:26:46.931004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:46.933772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance efd38835-5c39-470d-91d3-9bf5b47b2fec could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:46.933772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ea63b4ac-a8c0-4220-be73-df68b976cc96 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec" status: 404 len: 111 microversion: 2.1 time: 0.030871 Aug 31 19:26:46.933772 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 694/1345] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:46 2022] GET /compute/v2.1/servers/efd38835-5c39-470d-91d3-9bf5b47b2fec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:47.239830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:47.239830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:47.243874 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:47.244371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:47.244844 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:47.245657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:47.246086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:47.246490 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:47.401887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:47.412692 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-58f62aa3-70dc-4105-b191-be039c7205d3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.180967 Aug 31 19:26:47.413536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 652/1346] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:47 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:48.075789 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.076339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.082990 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.083477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.083904 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.084611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.085059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.085477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.099108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd HTTP/1.1 Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:48.101096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.102977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': 'a74c7954-70b5-4071-a5d4-af844041d3bd'} Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:48.104178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.105906 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.107326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:48.107326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7f0fc579-7aca-4263-b9bd-0eaede9d8e8d tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 404 len: 111 microversion: 2.1 time: 0.030510 Aug 31 19:26:48.107326 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 695/1347] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:48 2022] DELETE /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:48.111693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.112826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: a74c7954-70b5-4071-a5d4-af844041d3bd] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.120055 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.120730 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.121352 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.122049 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.122575 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.122914 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.137987 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd HTTP/1.1 Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:48.140173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.141840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': 'a74c7954-70b5-4071-a5d4-af844041d3bd'} Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:48.142724 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. Aug 31 19:26:48.144249 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.146637 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance a74c7954-70b5-4071-a5d4-af844041d3bd could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:48.147896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-06b71153-401c-4e78-ac95-791b05de6978 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd" status: 404 len: 111 microversion: 2.1 time: 0.040855 Aug 31 19:26:48.148481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 653/1348] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:48 2022] GET /compute/v2.1/servers/a74c7954-70b5-4071-a5d4-af844041d3bd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:48.157426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.158009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.166087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.166614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.167114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.167817 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.168339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.168861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.191808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f HTTP/1.1 Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:48.193396 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.195044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '0ed0083d-53d6-4dde-adff-552a74a61c5f'} Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:48.196069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.197591 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.199774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:48.200676 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f8661489-c3be-47ce-a912-ccd1edaf3218 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 404 len: 111 microversion: 2.1 time: 0.047794 Aug 31 19:26:48.201235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 696/1349] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:48 2022] DELETE /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:48.209636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.210237 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 0ed0083d-53d6-4dde-adff-552a74a61c5f] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.217649 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.218810 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.219436 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.220796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.221388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.222108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.243354 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f HTTP/1.1 Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:48.244935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.246664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '0ed0083d-53d6-4dde-adff-552a74a61c5f'} Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:48.247969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. Aug 31 19:26:48.252552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:48.254306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance 0ed0083d-53d6-4dde-adff-552a74a61c5f could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:48.254306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ac8eaf32-699b-4590-9ded-30d6c05af7fb tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f" status: 404 len: 111 microversion: 2.1 time: 0.040528 Aug 31 19:26:48.254306 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 654/1350] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:48 2022] GET /compute/v2.1/servers/0ed0083d-53d6-4dde-adff-552a74a61c5f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:48.435311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.436037 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.442911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.443487 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.444001 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.445478 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.445983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.635984 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:48.646044 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-0734dc92-24b3-4c1a-ba19-49ce0a7eaa08 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.214541 Aug 31 19:26:48.646994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 697/1351] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:48 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:49.410144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:49.410144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:49.412668 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:49.421664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.422482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.422927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.423983 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.424447 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.424935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.442975 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 HTTP/1.1 Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:26:49.444876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.446726 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '9952e4e3-5b71-4512-8bc4-cd0339fc24c7'} Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:49.447882 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.449564 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.454239 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:49.454711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-20fa1b41-363c-4a5c-bf43-cbf57115e37b tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 404 len: 111 microversion: 2.1 time: 0.049475 Aug 31 19:26:49.458981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 655/1352] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:49 2022] DELETE /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:49.465041 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:49.465919 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] [instance: 9952e4e3-5b71-4512-8bc4-cd0339fc24c7] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:49.468375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:49.472087 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:49.481700 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.482331 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.482847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.484791 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.485495 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.486132 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.504901 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] HTTP exception thrown: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Request method failure captured: Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 HTTP/1.1 Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PbHrsIXyCjPQSebc0skLOPBAokA6GEmSPxur5VkJMuRGJ8QYSD2RYAK9tIGAp5xFuCCiv4h3JsddFhA-tfEqqgYdPRsIO98g78EzowBYPLakXAdYPzBrY7YyfpjPDFpiJ4FrspHr3fttJ3p-RXpkAWTXUE5sQap-_4bwDGTYOvtUo Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:49.506857 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/1cb8f75600714e23bda1c8886bdb22f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 1cb8f75600714e23bda1c8886bdb22f1 Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1790030271 Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 6e09978ed8b3490db5f92823768f1d15 Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeNegativeTest-1790030271-project Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.508292 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '9952e4e3-5b71-4512-8bc4-cd0339fc24c7'} Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:49.509100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. Aug 31 19:26:49.510435 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:49.513790 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] Returning 404 to user: Instance 9952e4e3-5b71-4512-8bc4-cd0339fc24c7 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:49.515380 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-e788cf67-1412-40a2-85c0-f8ba2599d264 tempest-AttachVolumeNegativeTest-1790030271 tempest-AttachVolumeNegativeTest-1790030271-project] 10.222.0.95 "GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7" status: 404 len: 111 microversion: 2.1 time: 0.054613 Aug 31 19:26:49.516463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 698/1353] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:49 2022] GET /compute/v2.1/servers/9952e4e3-5b71-4512-8bc4-cd0339fc24c7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:49.669501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:49.671193 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:49.678414 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.679363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.680266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.681361 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.681911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.682669 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.851468 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:49.859667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5105ac02-4b24-4784-bfb4-d4ee85fbe5c1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.194149 Aug 31 19:26:49.860280 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 656/1354] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:49 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:50.883426 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:50.884928 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:50.893677 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:50.894356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:50.894970 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:50.896043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:50.896695 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:50.897819 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:51.104225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:51.115740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-f2ab0b6f-a4f0-455e-8ce5-e9bc820fd8c7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.237294 Aug 31 19:26:51.116717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 699/1355] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:50 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:52.137344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:52.138796 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:52.149384 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.150267 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.150840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.151634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.152180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.152749 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.298526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:52.306487 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bea44cd4-5b25-47b7-80eb-127699e5b0c3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.173485 Aug 31 19:26:52.308612 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 657/1356] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:52 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:53.328486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:53.329159 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:53.335925 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:53.336409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:53.337086 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:53.337796 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:53.338255 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:53.338682 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:53.488614 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:53.497777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-443c521d-4ed4-4b6a-abfc-b41f7b7a730c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.173848 Aug 31 19:26:53.498926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 700/1357] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:53 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:54.520972 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:54.521609 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:54.527453 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:54.527932 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:54.528369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:54.529085 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:54.529535 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:54.530769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:54.558560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-dcc79dd1-4f20-40bb-b345-b8423726c0a1 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Action: 'create', calling method: .version_select at 0x7f976329bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1864070735", "metadata": {"Type": "work"}}} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:54.669524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:54.677853 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-442e281d-939b-4ace-808d-bd68b8ab735b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.161606 Aug 31 19:26:54.678486 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 701/1358] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:54 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:54.868204 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-dcc79dd1-4f20-40bb-b345-b8423726c0a1 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.434014 Aug 31 19:26:54.868883 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 658/1359] 10.222.0.95 () {60 vars in 1156 bytes} [Wed Aug 31 19:26:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 19:26:54.883707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bb5b3210-4718-49af-9ce2-d2f6161fd567 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Calling method '.version_select at 0x7f975fbd1d30>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:54.937084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bb5b3210-4718-49af-9ce2-d2f6161fd567 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60" status: 200 len: 353 microversion: 2.1 time: 0.056424 Aug 31 19:26:54.937854 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 702/1360] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:26:54 2022] GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:55.432314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-c7637268-98ee-4564-8821-4bb2acfe8204 req-3ad1ff3b-cff9-45cd-a957-d5bb4ab4f837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535c47a4-fdfe-43c6-bb6e-76be6785b3df", "name": "network-vif-plugged", "status": "completed", "tag": "752b4a4f-7bac-4f69-adca-ca246584df96"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:55.448202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c7637268-98ee-4564-8821-4bb2acfe8204 req-3ad1ff3b-cff9-45cd-a957-d5bb4ab4f837 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.448702 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c7637268-98ee-4564-8821-4bb2acfe8204 req-3ad1ff3b-cff9-45cd-a957-d5bb4ab4f837 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.449128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-c7637268-98ee-4564-8821-4bb2acfe8204 req-3ad1ff3b-cff9-45cd-a957-d5bb4ab4f837 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.460141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-c7637268-98ee-4564-8821-4bb2acfe8204 req-3ad1ff3b-cff9-45cd-a957-d5bb4ab4f837 service nova] Creating event network-vif-plugged:752b4a4f-7bac-4f69-adca-ca246584df96 for instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df on hv-cinder-85221 Aug 31 19:26:55.465029 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-c7637268-98ee-4564-8821-4bb2acfe8204 req-3ad1ff3b-cff9-45cd-a957-d5bb4ab4f837 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041693 Aug 31 19:26:55.465793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 659/1361] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:55.701193 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:55.702356 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:55.709039 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.709749 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.710186 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.710959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.711406 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.711830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.864671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:55.872288 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-44916643-eb0a-4d12-af02-425572977387 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.176755 Aug 31 19:26:55.872892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 703/1362] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:55 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:55.951460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9907adec-68b3-46f7-ad04-9a84de28430a tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Calling method '.version_select at 0x7f976324d280>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:56.003206 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9907adec-68b3-46f7-ad04-9a84de28430a tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60" status: 200 len: 354 microversion: 2.1 time: 0.055826 Aug 31 19:26:56.003763 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 660/1363] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:26:55 2022] GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:56.016519 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-084d077e-279e-48e7-9cd3-b5765bdee4e1 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Calling method '.version_select at 0x7f97632e2af0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:56.067222 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-084d077e-279e-48e7-9cd3-b5765bdee4e1 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60" status: 200 len: 354 microversion: 2.1 time: 0.055068 Aug 31 19:26:56.067863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 704/1364] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:26:56 2022] GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:56.085761 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-f3fb6b28-ff9c-4e4f-9672-2b4d99d02f01 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Calling method '.version_select at 0x7f976324da60>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:56.162530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-f3fb6b28-ff9c-4e4f-9672-2b4d99d02f01 tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "DELETE /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60" status: 202 len: 0 microversion: 2.1 time: 0.080466 Aug 31 19:26:56.163174 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 661/1365] 10.222.0.95 () {58 vars in 1248 bytes} [Wed Aug 31 19:26:56 2022] DELETE /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:26:56.171621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-cfcb27c8-311e-4cfb-a424-3906c7df0dee tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Calling method '.version_select at 0x7f975f5783a0>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:56.227717 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-cfcb27c8-311e-4cfb-a424-3906c7df0dee tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60" status: 200 len: 353 microversion: 2.1 time: 0.060339 Aug 31 19:26:56.228272 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 705/1366] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:26:56 2022] GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:56.895384 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:56.896113 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:56.902826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:56.903309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:56.903745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:56.904455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:56.905086 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:56.905862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.049169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:57.057455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-d2606afa-6d68-443b-8c60-13f6b7a8e826 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1264 microversion: 2.1 time: 0.166602 Aug 31 19:26:57.058034 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 662/1367] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:56 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:57.244429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-40ee02e0-1a54-43c7-bf57-3332ddfcdacc tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Calling method '.version_select at 0x7f975f57e820>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:57.283859 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-40ee02e0-1a54-43c7-bf57-3332ddfcdacc tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] HTTP exception thrown: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-40ee02e0-1a54-43c7-bf57-3332ddfcdacc tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Request method failure captured: Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 HTTP/1.1 Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7X-8ZhKZtDVHUj5f-yh8Rvdb91vj-6lHs4diwWBZh01BkVDvlF_ZQ7eRjmbfhM8aR5RXHT9muo6em4VCiCQsdEUrbR28Fz29OxZsf43DJvUQso2nu9jLyE-KNe09x4CftVRFur3dVMgXHKQXzNBPI-RJG5WR89vfBG0u8a0vlZn8YA Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 0328689e0d4f4dbabdf06dff97dd8ad5 Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-VolumesGetTestJSON-1641081552 Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:26:57.286156 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0328689e0d4f4dbabdf06dff97dd8ad5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/0328689e0d4f4dbabdf06dff97dd8ad5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_0328689e0d4f4dbabdf06dff97dd8ad5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/0328689e0d4f4dbabdf06dff97dd8ad5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-VolumesGetTestJSON-1641081552 Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 0328689e0d4f4dbabdf06dff97dd8ad5 Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-VolumesGetTestJSON-1641081552 Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-VolumesGetTestJSON-1641081552-project Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 1c1bbd813918452fba618a78b4d0e2d6 Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-VolumesGetTestJSON-1641081552-project Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '17a90316-84be-4c29-9521-4f54798b5b60'} Aug 31 19:26:57.287735 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. (HTTP 404) (Request-ID: req-62f5537b-30eb-41c4-bf0e-cb64c187a88d) Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:57.289008 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:26:57.290473 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:26:57.292323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-40ee02e0-1a54-43c7-bf57-3332ddfcdacc tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] Returning 404 to user: Volume 17a90316-84be-4c29-9521-4f54798b5b60 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:26:57.293818 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-40ee02e0-1a54-43c7-bf57-3332ddfcdacc tempest-VolumesGetTestJSON-1641081552 tempest-VolumesGetTestJSON-1641081552-project] 10.222.0.95 "GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60" status: 404 len: 109 microversion: 2.1 time: 0.050803 Aug 31 19:26:57.295896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 706/1368] 10.222.0.95 () {58 vars in 1245 bytes} [Wed Aug 31 19:26:57 2022] GET /compute/v2.1/os-volumes/17a90316-84be-4c29-9521-4f54798b5b60 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:26:58.079278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:58.079887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:58.086405 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.086877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.087311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.088003 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.088453 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.088912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.239627 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:58.248885 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1cff547f-e2ab-4f98-972b-9ca3211831b1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1450 microversion: 2.1 time: 0.173537 Aug 31 19:26:58.249464 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 663/1369] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:58 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1450 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:58.270070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:58.270712 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:58.277058 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.277536 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.277974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.278674 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.279128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.279552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.431951 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:58.440634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-702df5a6-6a36-4a73-8acf-4cd18daea382 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1450 microversion: 2.1 time: 0.175136 Aug 31 19:26:58.448758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 707/1370] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:58 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:00.664705 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-529bacc7-a825-440a-bde9-3414993ecab3 req-ee94f1e7-1980-46d9-9d46-a893b74037e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535c47a4-fdfe-43c6-bb6e-76be6785b3df", "tag": "752b4a4f-7bac-4f69-adca-ca246584df96"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:00.676609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-529bacc7-a825-440a-bde9-3414993ecab3 req-ee94f1e7-1980-46d9-9d46-a893b74037e9 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:00.676609 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-529bacc7-a825-440a-bde9-3414993ecab3 req-ee94f1e7-1980-46d9-9d46-a893b74037e9 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:00.677057 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-529bacc7-a825-440a-bde9-3414993ecab3 req-ee94f1e7-1980-46d9-9d46-a893b74037e9 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:00.689144 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-529bacc7-a825-440a-bde9-3414993ecab3 req-ee94f1e7-1980-46d9-9d46-a893b74037e9 service nova] Creating event network-changed:752b4a4f-7bac-4f69-adca-ca246584df96 for instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df on hv-cinder-85221 Aug 31 19:27:00.698908 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-529bacc7-a825-440a-bde9-3414993ecab3 req-ee94f1e7-1980-46d9-9d46-a893b74037e9 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037761 Aug 31 19:27:00.699520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 664/1371] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:27:33.527483 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:33.531088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:33.534095 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:33.534760 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=96 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:33.541866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.542355 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.542787 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.543512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.543965 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.545065 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.585527 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-203b534d-19cb-496a-a7ab-1c74879c48ec tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062060 Aug 31 19:27:33.586119 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 708/1372] 10.222.0.95 () {60 vars in 1343 bytes} [Wed Aug 31 19:27:33 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:33.658927 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:33.659900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=83 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:33.665688 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:33.666289 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:33.676862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.677675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.678433 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.679628 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.680401 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.681172 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.720101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:27:33.812771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-0f138503-a0e3-4312-8c76-a153b14d6f88 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 204 len: 0 microversion: 2.20 time: 0.154772 Aug 31 19:27:33.814252 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 665/1373] 10.222.0.95 () {60 vars in 1280 bytes} [Wed Aug 31 19:27:33 2022] DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:27:33.823812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:33.825116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:33.834578 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.835286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.835730 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.836444 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.836923 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.837408 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:34.188237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:34.197626 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:34.199066 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:34.200232 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a2d51fc9-fb77-4038-9b27-8a573997c2fa tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.381407 Aug 31 19:27:34.201404 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 709/1374] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:33 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:27:35.227877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:35.228611 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:35.235768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:35.236166 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:35.236626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:35.237321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:35.237774 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:35.238198 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:35.421337 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:35.429393 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:35.430824 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:35.431969 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e3e53c4-64d4-4ef2-ae1d-a16e8a1dae59 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.208391 Aug 31 19:27:35.432524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 666/1375] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:35 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:36.455385 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:36.456424 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:36.462939 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:36.463447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:36.463892 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:36.464687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:36.465152 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:36.465581 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:36.611296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:36.619750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:36.621367 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:36.623103 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-11ea150e-9be0-4ef3-b6b8-4a431d22c174 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.171018 Aug 31 19:27:36.623805 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 710/1376] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:36 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:27:37.645904 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:37.646446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:37.652940 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:37.654091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:37.654997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:37.655488 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:37.655929 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:37.656344 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:37.802270 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:37.811208 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:37.812771 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:37.813834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-9f899d42-386b-4c6d-ba47-12438eecfbbf tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.171931 Aug 31 19:27:37.814387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 667/1377] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:37 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:38.838675 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:38.839304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:38.852640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:38.853142 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:38.853588 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:38.854354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:38.855012 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:38.855224 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:39.331354 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:39.340026 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:39.342205 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:39.343391 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-fb935456-8b73-4e33-bfd6-2918465ba8bb tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1723 microversion: 2.20 time: 0.509126 Aug 31 19:27:39.343945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 711/1378] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:38 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:39.902178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-5613e577-4874-4607-b32d-f162ab7521ef req-952fb944-dd52-4ea6-a011-81ccfee4b01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99", "name": "network-vif-deleted", "tag": "06e43707-9905-4237-8b77-5f37b0c8124b"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:39.912765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-5613e577-4874-4607-b32d-f162ab7521ef req-952fb944-dd52-4ea6-a011-81ccfee4b01e service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:39.913574 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-5613e577-4874-4607-b32d-f162ab7521ef req-952fb944-dd52-4ea6-a011-81ccfee4b01e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:39.913890 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-5613e577-4874-4607-b32d-f162ab7521ef req-952fb944-dd52-4ea6-a011-81ccfee4b01e service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:39.928315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-5613e577-4874-4607-b32d-f162ab7521ef req-952fb944-dd52-4ea6-a011-81ccfee4b01e service nova] Creating event network-vif-deleted:06e43707-9905-4237-8b77-5f37b0c8124b for instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 on hv-cinder-85221 Aug 31 19:27:39.933710 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-5613e577-4874-4607-b32d-f162ab7521ef req-952fb944-dd52-4ea6-a011-81ccfee4b01e service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035378 Aug 31 19:27:39.939593 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 668/1379] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:27:40.367582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:40.369169 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:40.376638 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:40.377228 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:40.378136 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:40.378914 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:40.379434 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:40.379929 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:40.447217 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:40.456125 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:40.457653 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:40.458822 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a2cc4758-8505-4fcf-a3f2-f7e7e9385af4 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1655 microversion: 2.20 time: 0.095282 Aug 31 19:27:40.459378 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 712/1380] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:40 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:41.483300 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:41.483984 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:41.490145 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:41.490619 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:41.491049 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:41.491729 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:41.492176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:41.492626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:41.555589 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:41.564509 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:41.565973 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:41.567109 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-a76ee628-b114-4dd5-818a-aa878ea0657f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1655 microversion: 2.20 time: 0.089316 Aug 31 19:27:41.567656 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 669/1381] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:41 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:42.589924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:42.590701 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:42.598374 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:42.598872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:42.599335 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:42.600223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:42.600732 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:42.601158 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:42.635471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:42.635946 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:42.636376 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:42.636841 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lazy-loading 'fault' on Instance uuid 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:27:42.687003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:42.695705 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:42.697196 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25c3f0a2e1fd4067b1804ef42faa46d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4adeb4ab309d44a6b3440df802f5bb25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:42.698350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-887248e8-e829-40ad-b8bd-6797ce44dde9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 200 len: 1370 microversion: 2.20 time: 0.112367 Aug 31 19:27:42.699074 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 713/1382] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:42 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:27:43.722857 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:43.723434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:43.730244 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:43.730826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:43.731273 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:43.731968 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:43.732425 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:43.732876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:43.746494 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] HTTP exception thrown: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Request method failure captured: Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 HTTP/1.1 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PYLfV9bWCXA0eLQBiX-k2f1F3xgSoGWKl_avym-zAeJwFoiKkK8W10-Enc-fbX4UDhA1ue7uRoBsmA5MSCe033lCM71T-0OxhLhxBYTrsYlDus-jbhzGPHAT7MAarvCLEQ-J7txA9ygqCcZgUsgd3LdO3Z3GyqTSUERE4u96oLZXo Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:27:43.748141 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 25c3f0a2e1fd4067b1804ef42faa46d5 Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:43.750066 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99'} Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:43.751021 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:43.752394 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:43.754028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Returning 404 to user: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:43.754028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8f9aadf3-0390-415c-8bae-12bdd4bc864a tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 404 len: 111 microversion: 2.20 time: 0.031192 Aug 31 19:27:43.754028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 670/1383] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:43 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:27:43.758752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-4f6f9221-f6cc-49c9-85fc-2156cfc49765 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '.version_select at 0x7f975fb3a700>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:43.799829 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-4f6f9221-f6cc-49c9-85fc-2156cfc49765 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46757239" status: 204 len: 0 microversion: 2.20 time: 0.044804 Aug 31 19:27:43.800413 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 714/1384] 10.222.0.95 () {60 vars in 1256 bytes} [Wed Aug 31 19:27:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46757239 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:27:47.726713 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:47.727210 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:47.735173 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:47.735678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:47.736111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:47.736840 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:47.737291 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:47.737711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:47.751846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] HTTP exception thrown: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Request method failure captured: Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 HTTP/1.1 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PYLfV9bWCXA0eLQBiX-k2f1F3xgSoGWKl_avym-zAeJwFoiKkK8W10-Enc-fbX4UDhA1ue7uRoBsmA5MSCe033lCM71T-0OxhLhxBYTrsYlDus-jbhzGPHAT7MAarvCLEQ-J7txA9ygqCcZgUsgd3LdO3Z3GyqTSUERE4u96oLZXo Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:27:47.753417 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 25c3f0a2e1fd4067b1804ef42faa46d5 Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.755045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99'} Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:47.756043 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.757510 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.759120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Returning 404 to user: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:47.759120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bb482930-ddef-471b-98c3-5a05e3ea6512 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 404 len: 111 microversion: 2.20 time: 0.031989 Aug 31 19:27:47.759120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 671/1385] 10.222.0.95 () {60 vars in 1280 bytes} [Wed Aug 31 19:27:47 2022] DELETE /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:27:47.764350 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:47.765034 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:47.773889 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:47.774373 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:47.774811 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:47.775512 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:47.775963 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:47.776389 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:47.794363 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] HTTP exception thrown: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Request method failure captured: Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 HTTP/1.1 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PYLfV9bWCXA0eLQBiX-k2f1F3xgSoGWKl_avym-zAeJwFoiKkK8W10-Enc-fbX4UDhA1ue7uRoBsmA5MSCe033lCM71T-0OxhLhxBYTrsYlDus-jbhzGPHAT7MAarvCLEQ-J7txA9ygqCcZgUsgd3LdO3Z3GyqTSUERE4u96oLZXo Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:27:47.796036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 25c3f0a2e1fd4067b1804ef42faa46d5 Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.798898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99'} Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:47.799861 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. Aug 31 19:27:47.801206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:47.804047 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Returning 404 to user: Instance 51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:47.804471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-83b329af-11b0-4bab-8a23-e0d27a94521c tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99" status: 404 len: 111 microversion: 2.20 time: 0.044434 Aug 31 19:27:47.805129 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 715/1386] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:47 2022] GET /compute/v2.1/servers/51d3fe15-138b-4d6c-8ea8-2ad12e2a9e99 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:27:49.125327 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:49.126068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:49.132153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:49.132653 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:49.133082 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:49.133761 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:49.134202 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:49.134617 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:49.148323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] HTTP exception thrown: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Request method failure captured: Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 HTTP/1.1 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7PYLfV9bWCXA0eLQBiX-k2f1F3xgSoGWKl_avym-zAeJwFoiKkK8W10-Enc-fbX4UDhA1ue7uRoBsmA5MSCe033lCM71T-0OxhLhxBYTrsYlDus-jbhzGPHAT7MAarvCLEQ-J7txA9ygqCcZgUsgd3LdO3Z3GyqTSUERE4u96oLZXo Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:27:49.149932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: 25c3f0a2e1fd4067b1804ef42faa46d5 Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.151814 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276'} Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:49.153097 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.155036 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.157330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Returning 404 to user: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:49.157330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b5b07abe-3e65-44f9-bbe3-9ebee9b42e4f tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 404 len: 111 microversion: 2.20 time: 0.030003 Aug 31 19:27:49.157330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 672/1387] 10.222.0.95 () {60 vars in 1280 bytes} [Wed Aug 31 19:27:49 2022] DELETE /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:27:49.160625 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:49.161233 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] [instance: 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:49.167559 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:49.168033 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:49.168463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:49.169242 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:49.169687 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:49.170108 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:49.184371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] HTTP exception thrown: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Request method failure captured: Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 HTTP/1.1 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7PYLfV9bWCXA0eLQBiX-k2f1F3xgSoGWKl_avym-zAeJwFoiKkK8W10-Enc-fbX4UDhA1ue7uRoBsmA5MSCe033lCM71T-0OxhLhxBYTrsYlDus-jbhzGPHAT7MAarvCLEQ-J7txA9ygqCcZgUsgd3LdO3Z3GyqTSUERE4u96oLZXo Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:27:49.185950 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/4adeb4ab309d44a6b3440df802f5bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: 4adeb4ab309d44a6b3440df802f5bb25 Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1125353118 Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: 25c3f0a2e1fd4067b1804ef42faa46d5 Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1125353118-project Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.188173 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276'} Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:49.189261 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. Aug 31 19:27:49.190619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:27:49.192199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] Returning 404 to user: Instance 67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:49.192199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7318720c-c98e-4e15-91cf-2a2abdaa19c9 tempest-AttachVolumeShelveTestJSON-1125353118 tempest-AttachVolumeShelveTestJSON-1125353118-project] 10.222.0.95 "GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276" status: 404 len: 111 microversion: 2.20 time: 0.031081 Aug 31 19:27:49.192199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 716/1388] 10.222.0.95 () {60 vars in 1277 bytes} [Wed Aug 31 19:27:49 2022] GET /compute/v2.1/servers/67bebc6e-c5c0-4b1c-aef7-38fc5fdcc276 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:29:16.625865 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:16.626667 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:16.630805 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:29:16.630956 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Wed Aug 31 19:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df (ip 10.222.0.95) !!! Aug 31 19:29:16.632524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:16.633267 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:16.641371 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:16.641868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:16.642309 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:16.643013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:16.644121 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:16.644600 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:16.673610 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:29:16.750096 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-83a0b15d-4d44-4a39-ad87-201e56b32c1d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "DELETE /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 204 len: 0 microversion: 2.1 time: 0.130885 Aug 31 19:29:16.750833 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 673/1389] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:29:16 2022] DELETE /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:29:16.760311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:29:16.760902 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Wed Aug 31 19:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df (ip 10.222.0.95) !!! Aug 31 19:29:16.762109 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:16.763237 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=42 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:16.764756 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 19:29:16.770924 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:16.771821 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:16.784054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:16.784775 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:16.785438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:16.786375 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:16.786930 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:16.787448 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:16.929599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:16.937414 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-ea79d208-30dd-4c0d-8397-6347cf166466 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1574 microversion: 2.1 time: 0.181025 Aug 31 19:29:16.937974 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 717/1390] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:16 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:17.961462 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:17.962258 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:17.969179 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:17.969791 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:17.971164 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:17.973045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:17.973501 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:17.973925 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:18.120985 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:18.129071 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2be8316b-49bf-44ac-ac6f-0db63cb80bb0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1574 microversion: 2.1 time: 0.172772 Aug 31 19:29:18.129654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 674/1391] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:17 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:19.150635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:19.151460 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:19.159442 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.159948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.160390 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.161149 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.161634 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.162070 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.311059 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:19.319792 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b6bf854b-5718-4596-9206-bf93f042ea65 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1574 microversion: 2.1 time: 0.173149 Aug 31 19:29:19.320371 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 718/1392] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:19 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:20.143877 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-456c6486-3ea3-4298-b47e-8e405c5858b2 req-a106e8d5-c502-4fff-a641-e38e71bb85a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535c47a4-fdfe-43c6-bb6e-76be6785b3df", "name": "network-vif-deleted", "tag": "752b4a4f-7bac-4f69-adca-ca246584df96"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:20.153567 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-456c6486-3ea3-4298-b47e-8e405c5858b2 req-a106e8d5-c502-4fff-a641-e38e71bb85a1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:20.154307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-456c6486-3ea3-4298-b47e-8e405c5858b2 req-a106e8d5-c502-4fff-a641-e38e71bb85a1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:20.154738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-456c6486-3ea3-4298-b47e-8e405c5858b2 req-a106e8d5-c502-4fff-a641-e38e71bb85a1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:20.167661 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-456c6486-3ea3-4298-b47e-8e405c5858b2 req-a106e8d5-c502-4fff-a641-e38e71bb85a1 service nova] Creating event network-vif-deleted:752b4a4f-7bac-4f69-adca-ca246584df96 for instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df on hv-cinder-85221 Aug 31 19:29:20.172711 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-456c6486-3ea3-4298-b47e-8e405c5858b2 req-a106e8d5-c502-4fff-a641-e38e71bb85a1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305839 Aug 31 19:29:20.173601 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 675/1393] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:20.344663 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:20.345734 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:20.356110 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:20.356633 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:20.357069 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:20.357820 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:20.358336 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:20.358793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:20.393995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:20.394855 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:20.395296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:20.395750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lazy-loading 'fault' on Instance uuid 535c47a4-fdfe-43c6-bb6e-76be6785b3df {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:29:20.441266 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:20.449267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd8c19d0-9bd4-49d9-841e-b1f1d8ceeded tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 200 len: 1229 microversion: 2.1 time: 0.111297 Aug 31 19:29:20.449850 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 719/1394] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:20 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:21.473203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:21.473907 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:21.480168 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:21.480678 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:21.481132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:21.481825 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:21.482284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:21.482706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:21.496677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] HTTP exception thrown: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Request method failure captured: Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df HTTP/1.1 Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7XBMs3YbvPTsRGS9I5F8zT1Ap9Mp_T2tw7-b-Yx9u3vomdGqb0x6L1NtcnRUq39OcueJjC2ysX6JDyYBSim6DwFTjz1visbvqqjz2Uvb3m0cQU6UeRP8pGdeVozljGiEM9sEEisYCCXq5Ny3ySrpPAFvFsuMC-YxEmy3hWnSYwGUpc Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:29:21.498314 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d5bd468566364f12abbacb3928316c78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestVolumeBootPattern-659878814 Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: bc1911f5d10c4fe38b6a6c4a0950726a Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:29:21.500159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '535c47a4-fdfe-43c6-bb6e-76be6785b3df'} Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:29:21.501285 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:29:21.503629 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:29:21.505214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Returning 404 to user: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:29:21.505214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-4692d42a-990c-49c2-95ea-4f486a4a092b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 404 len: 111 microversion: 2.1 time: 0.031902 Aug 31 19:29:21.505214 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 676/1395] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:21 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:29:21.600812 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1924854982", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-266363159", "security_groups": [{"name": "tempest-secgroup-smoke-438942654"}], "block_device_mapping_v2": [{"uuid": "ae3c8e7d-c2ae-420d-9d40-844505d3b574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d49a59f8-0818-4aaa-809c-d0ae00d3fb2d"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:21.718622 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] validate_networks() for [('d49a59f8-0818-4aaa-809c-d0ae00d3fb2d', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:29:22.205685 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:29:22.206694 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:29:22.207364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:29:22.207783 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:29:22.208198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:29:22.217198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:22.217681 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:22.218123 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:22.218849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:22.219301 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:22.219727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:22.236754 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for project d5bd468566364f12abbacb3928316c78. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:29:22.240996 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for user bc1911f5d10c4fe38b6a6c4a0950726a and project d5bd468566364f12abbacb3928316c78. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:29:22.299808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:29:22.302194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae3c8e7d-c2ae-420d-9d40-844505d3b574',volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:29:22.439317 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a3e1631d-83b6-40b0-ae86-81894708c011 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.843251 Aug 31 19:29:22.439964 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 720/1396] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:29:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:29:22.452025 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-72a84a8e-e348-4c5e-add3-753815ad80fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:22.452662 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-72a84a8e-e348-4c5e-add3-753815ad80fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:22.513780 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-72a84a8e-e348-4c5e-add3-753815ad80fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:22.522000 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-72a84a8e-e348-4c5e-add3-753815ad80fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1094 microversion: 2.1 time: 0.073779 Aug 31 19:29:22.522573 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 677/1397] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:22 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:23.543763 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-60024b09-e406-4b84-9f4f-368285e0f7fa tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:23.544364 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-60024b09-e406-4b84-9f4f-368285e0f7fa tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:23.599815 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-60024b09-e406-4b84-9f4f-368285e0f7fa tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:23.606795 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-60024b09-e406-4b84-9f4f-368285e0f7fa tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1094 microversion: 2.1 time: 0.067320 Aug 31 19:29:23.607353 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 721/1398] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:23 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:24.627448 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-b4188934-714f-439b-902c-f45509142eb9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:24.628322 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-b4188934-714f-439b-902c-f45509142eb9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:24.683409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-b4188934-714f-439b-902c-f45509142eb9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:24.691388 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-b4188934-714f-439b-902c-f45509142eb9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1094 microversion: 2.1 time: 0.067797 Aug 31 19:29:24.691977 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 678/1399] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:24 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:25.712279 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5dbad96a-0c09-45a6-9fc1-505a2a18f349 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:25.713019 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5dbad96a-0c09-45a6-9fc1-505a2a18f349 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:25.767296 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5dbad96a-0c09-45a6-9fc1-505a2a18f349 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:25.775311 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5dbad96a-0c09-45a6-9fc1-505a2a18f349 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1094 microversion: 2.1 time: 0.066944 Aug 31 19:29:25.775883 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 722/1400] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:25 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:26.796302 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:26.797020 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:26.804131 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:26.804630 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:26.805182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:26.805891 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:26.806342 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:26.806766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:26.870320 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:26.880675 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-67ce6791-38e6-4058-bf70-2f84d13d31d0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1144 microversion: 2.1 time: 0.088334 Aug 31 19:29:26.881375 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 679/1401] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:26 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:27.903004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:27.903649 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:27.909962 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.911031 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.911666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.912369 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.912856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.913286 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.976057 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:27.984447 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c059b7db-1008-456e-951b-56ecfd4e5778 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1210 microversion: 2.1 time: 0.085283 Aug 31 19:29:27.985397 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 723/1402] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:27 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:29.007643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:29.008255 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:29.010382 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:29:29.010530 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Wed Aug 31 19:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 (ip 10.222.0.95) !!! Aug 31 19:29:29.016993 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.017482 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.017939 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.018634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.019203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.020278 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.178577 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:29.187169 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c22fc72f-60dd-483f-8807-1877d84d965e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.184095 Aug 31 19:29:29.187476 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 680/1403] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:29 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:29.311225 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-d77c8fc1-cb94-4cb7-a51a-ff927784d5cc req-e1003a27-6747-43f7-9a72-0e73f35551b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e60f2b4-e476-4514-bd20-98e4405585f4", "tag": "f9be4416-8330-4185-899b-dbd80c36cdd5"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:29.338842 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-d77c8fc1-cb94-4cb7-a51a-ff927784d5cc req-e1003a27-6747-43f7-9a72-0e73f35551b2 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.340021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-d77c8fc1-cb94-4cb7-a51a-ff927784d5cc req-e1003a27-6747-43f7-9a72-0e73f35551b2 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.340759 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-d77c8fc1-cb94-4cb7-a51a-ff927784d5cc req-e1003a27-6747-43f7-9a72-0e73f35551b2 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.357571 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-d77c8fc1-cb94-4cb7-a51a-ff927784d5cc req-e1003a27-6747-43f7-9a72-0e73f35551b2 service nova] Creating event network-changed:f9be4416-8330-4185-899b-dbd80c36cdd5 for instance 4e60f2b4-e476-4514-bd20-98e4405585f4 on hv-cinder-85221 Aug 31 19:29:29.371782 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-d77c8fc1-cb94-4cb7-a51a-ff927784d5cc req-e1003a27-6747-43f7-9a72-0e73f35551b2 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075237 Aug 31 19:29:29.372562 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 724/1404] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:30.208147 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:30.208864 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:30.215325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.215852 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.216292 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.217044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.218153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.218643 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.367560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.375435 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-36c2d81a-47b5-4d7b-8ba6-09c054f4a2fc tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.171445 Aug 31 19:29:30.376035 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 681/1405] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:30 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:31.397661 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:31.398269 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:31.408948 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:31.409439 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:31.409988 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.411436 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:31.411899 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:31.412340 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.548594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:31.556623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-481a18ad-c884-48d9-9026-df895c927983 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.164384 Aug 31 19:29:31.557195 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 725/1406] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:31 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:32.577647 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:32.578284 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:32.585406 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:32.585886 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:32.586321 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:32.587019 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:32.587466 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:32.587895 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:32.728201 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:32.735932 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5b208382-7c42-40d9-b21f-037869142d78 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.162136 Aug 31 19:29:32.736490 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 682/1407] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:32 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:33.758075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:33.758692 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:33.760659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:33.766752 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:33.767223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:33.767688 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:33.768605 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:33.769004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:33.769530 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:33.911716 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:33.919518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3713d636-5e1f-446a-a34a-9fddb50cd71d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.165932 Aug 31 19:29:33.920082 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 726/1408] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:33 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:34.943188 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:34.943768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:34.946311 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=4 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:34.952829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:34.953408 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:34.954120 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:34.954446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:34.954900 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:34.955524 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:35.118220 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:35.127892 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cac678da-7c6e-468b-bc75-e89f76d5a183 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.189324 Aug 31 19:29:35.128538 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 683/1409] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:34 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:36.148128 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=10 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:36.152226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:36.152856 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:36.160602 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:36.161075 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:36.161504 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:36.162194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:36.162640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:36.163054 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:36.308133 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:36.315993 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-471ea52b-f0fe-4332-9f2a-a9e27a3cbb59 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.169115 Aug 31 19:29:36.317100 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 727/1410] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:36 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:37.340135 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:37.340887 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:37.347047 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:37.347631 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:37.348093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:37.348826 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:37.349282 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:37.349706 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:37.483429 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:37.491217 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-cbaeb90e-46a3-41db-99db-f0226bd69fc6 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.157914 Aug 31 19:29:37.491784 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 684/1411] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:37 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:38.512116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:38.512952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:38.519592 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:38.520671 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:38.521124 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:38.521845 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:38.522289 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:38.522721 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:38.667215 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:38.674976 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5adb1f32-f94b-44af-a169-dc7f9c5309b8 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.166750 Aug 31 19:29:38.675547 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 728/1412] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:38 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:39.697180 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:39.697794 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:39.704155 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.704665 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.705093 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:39.705778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.706221 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.706634 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:39.847028 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:39.855386 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-1d996a5d-6391-4517-bfb6-f2fd44329ea7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.162027 Aug 31 19:29:39.855875 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 685/1413] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:39 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:40.876223 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:40.876846 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:40.883849 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:40.884337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:40.884810 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:40.885518 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:40.885973 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:40.886400 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:41.027015 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:41.035042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-42d62f55-7092-4c25-ba02-2d28129559a7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.162989 Aug 31 19:29:41.035615 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 729/1414] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:40 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:41.297307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-73abe178-5b99-457b-a715-c1be4328bc3b req-1c332f19-8bf9-41b6-933f-583d7557a991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e60f2b4-e476-4514-bd20-98e4405585f4", "name": "network-vif-plugged", "status": "completed", "tag": "f9be4416-8330-4185-899b-dbd80c36cdd5"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:41.307529 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-73abe178-5b99-457b-a715-c1be4328bc3b req-1c332f19-8bf9-41b6-933f-583d7557a991 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:41.308004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-73abe178-5b99-457b-a715-c1be4328bc3b req-1c332f19-8bf9-41b6-933f-583d7557a991 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:41.308434 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-73abe178-5b99-457b-a715-c1be4328bc3b req-1c332f19-8bf9-41b6-933f-583d7557a991 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:41.320203 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-73abe178-5b99-457b-a715-c1be4328bc3b req-1c332f19-8bf9-41b6-933f-583d7557a991 service nova] Creating event network-vif-plugged:f9be4416-8330-4185-899b-dbd80c36cdd5 for instance 4e60f2b4-e476-4514-bd20-98e4405585f4 on hv-cinder-85221 Aug 31 19:29:41.325267 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-73abe178-5b99-457b-a715-c1be4328bc3b req-1c332f19-8bf9-41b6-933f-583d7557a991 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109062 Aug 31 19:29:41.325876 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 686/1415] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:42.055392 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:42.056049 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:42.062608 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:42.063092 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:42.063528 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:42.064239 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:42.064727 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:42.065139 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:42.202064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:42.210131 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-6d71a527-b1a5-437d-904b-a523c4926ddb tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1265 microversion: 2.1 time: 0.158645 Aug 31 19:29:42.210711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 730/1416] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:42 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:43.231778 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:43.232480 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:43.238664 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:43.239834 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:43.240481 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:43.241299 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:43.241759 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:43.242189 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:43.376526 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:43.384426 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e6edea3d-2e5a-45b9-a10b-a0ef70b6e5d2 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1452 microversion: 2.1 time: 0.157290 Aug 31 19:29:43.385013 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 687/1417] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:43 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:43.405995 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:43.406611 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:43.413952 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:43.414429 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:43.414865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:43.415556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:43.416009 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:43.416465 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:43.552839 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:43.560610 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-a1ca0294-07ff-4cd8-b11e-266151493e6c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1452 microversion: 2.1 time: 0.158726 Aug 31 19:29:43.561180 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 731/1418] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:43 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:45.213479 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-f0429bd4-7df9-4b9c-9d90-cba1df45d76b req-5c96c390-f9d6-437e-b124-37756da315ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e60f2b4-e476-4514-bd20-98e4405585f4", "tag": "f9be4416-8330-4185-899b-dbd80c36cdd5"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:45.222657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f0429bd4-7df9-4b9c-9d90-cba1df45d76b req-5c96c390-f9d6-437e-b124-37756da315ab service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:45.223153 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f0429bd4-7df9-4b9c-9d90-cba1df45d76b req-5c96c390-f9d6-437e-b124-37756da315ab service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:45.223738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f0429bd4-7df9-4b9c-9d90-cba1df45d76b req-5c96c390-f9d6-437e-b124-37756da315ab service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:45.234626 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-f0429bd4-7df9-4b9c-9d90-cba1df45d76b req-5c96c390-f9d6-437e-b124-37756da315ab service nova] Creating event network-changed:f9be4416-8330-4185-899b-dbd80c36cdd5 for instance 4e60f2b4-e476-4514-bd20-98e4405585f4 on hv-cinder-85221 Aug 31 19:29:45.239395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-f0429bd4-7df9-4b9c-9d90-cba1df45d76b req-5c96c390-f9d6-437e-b124-37756da315ab service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086515 Aug 31 19:29:45.240161 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 688/1419] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:33.459696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:33.460438 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=72 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:33.461784 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:31:33.461935 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Wed Aug 31 19:31:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.95) !!! Aug 31 19:31:33.466953 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-30997041", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-266363159", "security_groups": [{"name": "tempest-secgroup-smoke-438942654"}], "block_device_mapping_v2": [{"uuid": "8bb8a026-4541-4349-bf98-70c227a0ccc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d49a59f8-0818-4aaa-809c-d0ae00d3fb2d"}]}} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:33.585323 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.network.neutron [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] validate_networks() for [('d49a59f8-0818-4aaa-809c-d0ae00d3fb2d', None, None, None, None, None)] {{(pid=120706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:31:34.206339 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Flavor limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:31:34.206764 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Image limits 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:31:34.207242 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Flavor pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:31:34.207652 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Image pref 0:0:0 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:31:34.208088 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.virt.hardware [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:31:34.217945 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.218425 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.218863 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.219593 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.220048 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.220476 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.237120 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for project d5bd468566364f12abbacb3928316c78. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:31:34.241089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.quota [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Getting quotas for user bc1911f5d10c4fe38b6a6c4a0950726a and project d5bd468566364f12abbacb3928316c78. Resources: {'instances', 'ram', 'cores'} {{(pid=120706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:31:34.298507 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Going to run 1 instances... {{(pid=120706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:31:34.300640 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8bb8a026-4541-4349-bf98-70c227a0ccc2',volume_size=None,volume_type=None)] {{(pid=120706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:31:34.429482 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-d1474889-34b0-46a6-95e2-a24d8fd34eb7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.971408 Aug 31 19:31:34.430116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 732/1420] 10.222.0.95 () {60 vars in 1147 bytes} [Wed Aug 31 19:31:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:31:34.439916 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.440765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:34.447837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-fe9918d9-d89a-43d2-975a-0890bf6815e3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:34.448693 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-fe9918d9-d89a-43d2-975a-0890bf6815e3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:34.505015 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-fe9918d9-d89a-43d2-975a-0890bf6815e3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:34.512520 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-fe9918d9-d89a-43d2-975a-0890bf6815e3 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1092 microversion: 2.1 time: 0.074944 Aug 31 19:31:34.513128 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 689/1421] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:34 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:35.534488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:35.535084 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:35.542680 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.543159 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.543594 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.544304 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.544773 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.545199 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.605313 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:35.612866 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-929f20e9-bf79-477d-ac63-ab949eadfbfd tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1190 microversion: 2.1 time: 0.082895 Aug 31 19:31:35.613424 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 733/1422] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:35 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1190 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:36.636307 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:36.637911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:36.651754 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.652253 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.652718 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.658254 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.659264 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.660277 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.844933 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:36.853215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2b220847-e688-485d-bcf8-ffbdd076e20d tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1275 microversion: 2.1 time: 0.222222 Aug 31 19:31:36.853981 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 690/1423] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:36 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:37.176769 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-47ea2c87-952e-4271-b324-f30b06e238bc req-ac3a4b06-b42b-4e2e-99e3-0e8278f2e0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed2cff6-c17e-414e-96c5-50035029f9ef", "tag": "bac820de-4bf9-4aa6-bdd1-1a72bfff9a55"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:37.191020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-47ea2c87-952e-4271-b324-f30b06e238bc req-ac3a4b06-b42b-4e2e-99e3-0e8278f2e0d1 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.191566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-47ea2c87-952e-4271-b324-f30b06e238bc req-ac3a4b06-b42b-4e2e-99e3-0e8278f2e0d1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.192245 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-47ea2c87-952e-4271-b324-f30b06e238bc req-ac3a4b06-b42b-4e2e-99e3-0e8278f2e0d1 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.205446 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-47ea2c87-952e-4271-b324-f30b06e238bc req-ac3a4b06-b42b-4e2e-99e3-0e8278f2e0d1 service nova] Creating event network-changed:bac820de-4bf9-4aa6-bdd1-1a72bfff9a55 for instance 4ed2cff6-c17e-414e-96c5-50035029f9ef on hv-cinder-85221 Aug 31 19:31:37.210517 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-47ea2c87-952e-4271-b324-f30b06e238bc req-ac3a4b06-b42b-4e2e-99e3-0e8278f2e0d1 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038639 Aug 31 19:31:37.211181 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 734/1424] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:37.873911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:37.874536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:37.880935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.881768 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.881920 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.882536 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.883091 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.884016 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:38.040641 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:38.049773 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c5e92219-a842-4d3a-9c2b-b1121e1cf4e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.179747 Aug 31 19:31:38.050720 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 691/1425] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:37 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:39.075488 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:39.076198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:39.083020 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.083501 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.083934 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.084659 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.085114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.085540 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.225589 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:39.234029 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9094a425-7ef9-4009-8b16-a0ebad6dd2b9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.163630 Aug 31 19:31:39.234599 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 735/1426] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:39 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:40.255068 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:40.255741 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:40.262935 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.263418 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.263850 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.264541 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.265039 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.265459 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.397942 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:40.406923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-bae1f40d-bd83-4374-a6d5-c94c29c10b80 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.155649 Aug 31 19:31:40.407546 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 692/1427] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:40 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:41.427534 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:41.428143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:41.435096 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:41.435563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:41.435989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.436707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:41.437141 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:41.437556 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.570014 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:41.577665 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-7b749df2-58e1-424d-8126-58dd73d9471e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.153971 Aug 31 19:31:41.578235 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 736/1428] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:41 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:42.598663 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:42.599215 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:42.606560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.607037 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.607470 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.608159 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.608701 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.609127 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.737079 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:42.745305 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-741b3dca-e7f7-4605-bfb0-26b698ae1621 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.150564 Aug 31 19:31:42.745862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 693/1429] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:42 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:43.765827 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:43.766437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:43.772931 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:43.773409 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:43.774830 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.775532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:43.775987 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:43.776418 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.911936 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:43.920280 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-c10903aa-7721-4dd1-86d8-2be77096bf26 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.158272 Aug 31 19:31:43.920872 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 737/1430] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:43 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:44.941847 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:44.942409 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:44.944734 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell0:SELECT=2 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:44.951387 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.951862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.952288 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:44.952997 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.953452 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.953869 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:45.083766 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:45.091483 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8ad80e19-ea0c-430f-97d1-9b8773c47ce7 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.153555 Aug 31 19:31:45.092044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 694/1431] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:44 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:46.111539 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:46.112154 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:46.114114 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=2 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:46.114918 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell0:SELECT=6 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:46.123786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.123786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.123786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.123786 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.124257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.124403 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.261569 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:46.269337 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-3d2e08a0-1029-4849-9f95-1fb12f42cb07 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.161689 Aug 31 19:31:46.269909 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 738/1432] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:46 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:47.291848 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:47.292449 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:47.298817 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.299298 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.299732 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.300420 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.300898 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.301318 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.434979 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:47.442537 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-ece9ab99-5c85-4c45-a99b-d6bd62b0bfc1 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.155457 Aug 31 19:31:47.443085 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 695/1433] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:47 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:47.762722 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-5a4bbe90-ed81-4393-9676-23c39e267f24 req-b1aec7b4-b4f1-4738-8b5b-d1ba1362a517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed2cff6-c17e-414e-96c5-50035029f9ef", "name": "network-vif-plugged", "status": "completed", "tag": "bac820de-4bf9-4aa6-bdd1-1a72bfff9a55"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:47.772875 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-5a4bbe90-ed81-4393-9676-23c39e267f24 req-b1aec7b4-b4f1-4738-8b5b-d1ba1362a517 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.773351 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-5a4bbe90-ed81-4393-9676-23c39e267f24 req-b1aec7b4-b4f1-4738-8b5b-d1ba1362a517 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.773826 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-5a4bbe90-ed81-4393-9676-23c39e267f24 req-b1aec7b4-b4f1-4738-8b5b-d1ba1362a517 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.786532 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-5a4bbe90-ed81-4393-9676-23c39e267f24 req-b1aec7b4-b4f1-4738-8b5b-d1ba1362a517 service nova] Creating event network-vif-plugged:bac820de-4bf9-4aa6-bdd1-1a72bfff9a55 for instance 4ed2cff6-c17e-414e-96c5-50035029f9ef on hv-cinder-85221 Aug 31 19:31:47.791750 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-5a4bbe90-ed81-4393-9676-23c39e267f24 req-b1aec7b4-b4f1-4738-8b5b-d1ba1362a517 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033608 Aug 31 19:31:47.792344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 739/1434] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:48.463793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:48.464416 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:48.471209 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.471690 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.472125 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.472846 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.473301 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.473725 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.610042 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:48.619868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-e0efbcc7-abd0-4ad8-a303-8610861048e9 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.160547 Aug 31 19:31:48.620441 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 696/1435] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:48 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:49.641566 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:49.642190 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:49.648267 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:49.648793 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:49.649922 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.650672 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:49.651122 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:49.651552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.791273 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:49.799265 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-66fdc4e3-880e-4a11-b92d-0680ba04c891 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1263 microversion: 2.1 time: 0.162443 Aug 31 19:31:49.799847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 740/1436] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:49 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:50.819837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:50.820484 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:50.827423 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.827895 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.828323 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.829044 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.829493 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.829911 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.959496 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:50.968315 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-15942da2-51be-4dc1-a3e0-ffa21116db33 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1449 microversion: 2.1 time: 0.152250 Aug 31 19:31:50.968918 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 697/1437] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:50 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:50.988620 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:50.989334 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:50.996226 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.996736 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.997178 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.997873 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.998322 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.998748 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:51.131668 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:51.140089 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-633bac6e-ad03-4ad1-8128-037c8341e86c tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1449 microversion: 2.1 time: 0.155266 Aug 31 19:31:51.140666 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 741/1438] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:50 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:52.705553 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-03b25e28-4a71-42f7-a052-499832692b9e req-3a4bed87-ae2d-4dde-b9d2-69078d8ec137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed2cff6-c17e-414e-96c5-50035029f9ef", "tag": "bac820de-4bf9-4aa6-bdd1-1a72bfff9a55"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:52.716654 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-03b25e28-4a71-42f7-a052-499832692b9e req-3a4bed87-ae2d-4dde-b9d2-69078d8ec137 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:52.717132 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-03b25e28-4a71-42f7-a052-499832692b9e req-3a4bed87-ae2d-4dde-b9d2-69078d8ec137 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:52.717562 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-03b25e28-4a71-42f7-a052-499832692b9e req-3a4bed87-ae2d-4dde-b9d2-69078d8ec137 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:52.730896 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-03b25e28-4a71-42f7-a052-499832692b9e req-3a4bed87-ae2d-4dde-b9d2-69078d8ec137 service nova] Creating event network-changed:bac820de-4bf9-4aa6-bdd1-1a72bfff9a55 for instance 4ed2cff6-c17e-414e-96c5-50035029f9ef on hv-cinder-85221 Aug 31 19:31:52.736765 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-03b25e28-4a71-42f7-a052-499832692b9e req-3a4bed87-ae2d-4dde-b9d2-69078d8ec137 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035028 Aug 31 19:31:52.737358 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 698/1439] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:24.000846 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.002437 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG dbcounter [-] [120706] Writing DB stats nova_cell1:SELECT=48 {{(pid=120706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.004738 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_api:SELECT=22 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.005491 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG dbcounter [-] [120707] Writing DB stats nova_cell1:SELECT=50 {{(pid=120707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.006967 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:33:24.007111 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Wed Aug 31 19:33:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.95) !!! Aug 31 19:33:24.008330 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:33:24.008455 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Wed Aug 31 19:33:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.95) !!! Aug 31 19:33:24.013780 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:24.013980 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:24.016167 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-3393a53e-8c8c-447a-b54d-25bfec2057c3 req-af0cc79a-9c9d-49a9-ad8a-6a2f962eb9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed2cff6-c17e-414e-96c5-50035029f9ef", "tag": "bac820de-4bf9-4aa6-bdd1-1a72bfff9a55"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:24.022898 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.023582 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.026003 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.026740 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.029621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.030064 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.030312 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-3393a53e-8c8c-447a-b54d-25bfec2057c3 req-af0cc79a-9c9d-49a9-ad8a-6a2f962eb9d9 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.030789 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-3393a53e-8c8c-447a-b54d-25bfec2057c3 req-af0cc79a-9c9d-49a9-ad8a-6a2f962eb9d9 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.031216 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-3393a53e-8c8c-447a-b54d-25bfec2057c3 req-af0cc79a-9c9d-49a9-ad8a-6a2f962eb9d9 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.042793 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-3393a53e-8c8c-447a-b54d-25bfec2057c3 req-af0cc79a-9c9d-49a9-ad8a-6a2f962eb9d9 service nova] Creating event network-changed:bac820de-4bf9-4aa6-bdd1-1a72bfff9a55 for instance 4ed2cff6-c17e-414e-96c5-50035029f9ef on hv-cinder-85221 Aug 31 19:33:24.048073 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-3393a53e-8c8c-447a-b54d-25bfec2057c3 req-af0cc79a-9c9d-49a9-ad8a-6a2f962eb9d9 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046012 Aug 31 19:33:24.048988 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 699/1440] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:24.056903 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Going to try to terminate instance {{(pid=120706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:33:24.161656 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-96189af5-94c1-455f-880b-461fca5b1e11 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "DELETE /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 204 len: 0 microversion: 2.1 time: 0.162968 Aug 31 19:33:24.162254 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 742/1441] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:33:23 2022] DELETE /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:33:24.171762 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:24.173645 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:24.180870 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.181363 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.181868 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.182642 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.183234 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.184651 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.384779 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:24.393212 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-8db2b15a-6f67-48e6-8af3-05db4070d02f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1573 microversion: 2.1 time: 0.226375 Aug 31 19:33:24.393818 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 700/1442] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:24 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1573 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:25.415040 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:25.415641 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:25.422868 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:25.423344 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:25.423865 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:25.424563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:25.425042 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:25.425462 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:25.607207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:25.614911 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-05f5e4dc-019f-4d04-9afb-7a3d9c0db178 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1573 microversion: 2.1 time: 0.204361 Aug 31 19:33:25.615471 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 743/1443] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:25 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:26.635505 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:26.636106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:26.650106 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:26.650657 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:26.651081 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:26.653745 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:26.654271 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:26.655126 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:26.659207 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-5e3ff125-f28c-4a1e-8f6b-ac330137fdf3 req-0be5747f-1021-4e40-b9ed-9279a1943ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed2cff6-c17e-414e-96c5-50035029f9ef", "name": "network-vif-deleted", "tag": "bac820de-4bf9-4aa6-bdd1-1a72bfff9a55"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:26.669463 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-5e3ff125-f28c-4a1e-8f6b-ac330137fdf3 req-0be5747f-1021-4e40-b9ed-9279a1943ab6 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:26.669947 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-5e3ff125-f28c-4a1e-8f6b-ac330137fdf3 req-0be5747f-1021-4e40-b9ed-9279a1943ab6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:26.670372 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-5e3ff125-f28c-4a1e-8f6b-ac330137fdf3 req-0be5747f-1021-4e40-b9ed-9279a1943ab6 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:26.682319 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-5e3ff125-f28c-4a1e-8f6b-ac330137fdf3 req-0be5747f-1021-4e40-b9ed-9279a1943ab6 service nova] Creating event network-vif-deleted:bac820de-4bf9-4aa6-bdd1-1a72bfff9a55 for instance 4ed2cff6-c17e-414e-96c5-50035029f9ef on hv-cinder-85221 Aug 31 19:33:26.688027 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-5e3ff125-f28c-4a1e-8f6b-ac330137fdf3 req-0be5747f-1021-4e40-b9ed-9279a1943ab6 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Aug 31 19:33:26.689143 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 744/1444] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:26.727535 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:26.736076 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-33ccfda6-226f-4d35-9ad5-7aa2ca28c4c4 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 200 len: 1388 microversion: 2.1 time: 0.104346 Aug 31 19:33:26.736676 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 701/1445] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:26 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 1388 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:27.758598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:27.759299 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4ed2cff6-c17e-414e-96c5-50035029f9ef] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:27.766043 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:27.766563 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:27.767004 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:27.767704 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:27.768201 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:27.768696 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:27.782552 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] HTTP exception thrown: Instance 4ed2cff6-c17e-414e-96c5-50035029f9ef could not be found. Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Request method failure captured: Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef HTTP/1.1 Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7XBMs3YbvPTsRGS9I5F8zT1Ap9Mp_T2tw7-b-Yx9u3vomdGqb0x6L1NtcnRUq39OcueJjC2ysX6JDyYBSim6DwFTjz1visbvqqjz2Uvb3m0cQU6UeRP8pGdeVozljGiEM9sEEisYCCXq5Ny3ySrpPAFvFsuMC-YxEmy3hWnSYwGUpc Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:33:27.784194 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d5bd468566364f12abbacb3928316c78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: bc1911f5d10c4fe38b6a6c4a0950726a Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 4ed2cff6-c17e-414e-96c5-50035029f9ef could not be found. Aug 31 19:33:27.785834 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '4ed2cff6-c17e-414e-96c5-50035029f9ef'} Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed2cff6-c17e-414e-96c5-50035029f9ef could not be found. Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:33:27.787116 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed2cff6-c17e-414e-96c5-50035029f9ef could not be found. Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed2cff6-c17e-414e-96c5-50035029f9ef could not be found. Aug 31 19:33:27.788926 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:27.790619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Returning 404 to user: Instance 4ed2cff6-c17e-414e-96c5-50035029f9ef could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:33:27.790619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b63cb9c9-4cab-4f7c-a3a9-c53a78e5cdc5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef" status: 404 len: 111 microversion: 2.1 time: 0.032091 Aug 31 19:33:27.790619 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 745/1446] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:27 2022] GET /compute/v2.1/servers/4ed2cff6-c17e-414e-96c5-50035029f9ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:31.126838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:31.127357 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:31.131604 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [req-56fa6373-5881-4f12-aeae-1574cd562a30 req-c739bcea-4a1c-42b4-8136-2865e7ff0fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e60f2b4-e476-4514-bd20-98e4405585f4", "tag": "f9be4416-8330-4185-899b-dbd80c36cdd5"}]} {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:31.134980 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:31.135735 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:31.136350 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:31.137058 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:31.137743 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:31.138238 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:31.145977 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-56fa6373-5881-4f12-aeae-1574cd562a30 req-c739bcea-4a1c-42b4-8136-2865e7ff0fd8 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:31.146711 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-56fa6373-5881-4f12-aeae-1574cd562a30 req-c739bcea-4a1c-42b4-8136-2865e7ff0fd8 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:31.147140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [req-56fa6373-5881-4f12-aeae-1574cd562a30 req-c739bcea-4a1c-42b4-8136-2865e7ff0fd8 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:31.161983 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.compute.server_external_events [req-56fa6373-5881-4f12-aeae-1574cd562a30 req-c739bcea-4a1c-42b4-8136-2865e7ff0fd8 service nova] Creating event network-changed:f9be4416-8330-4185-899b-dbd80c36cdd5 for instance 4e60f2b4-e476-4514-bd20-98e4405585f4 on hv-cinder-85221 Aug 31 19:33:31.166101 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Going to try to terminate instance {{(pid=120707) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:33:31.168257 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [req-56fa6373-5881-4f12-aeae-1574cd562a30 req-c739bcea-4a1c-42b4-8136-2865e7ff0fd8 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041855 Aug 31 19:33:31.168908 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 746/1447] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:31.256023 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-65000a99-69b3-43f8-9bfd-54bb5cd1fc5e tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "DELETE /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 204 len: 0 microversion: 2.1 time: 0.133008 Aug 31 19:33:31.256502 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 702/1448] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:33:31 2022] DELETE /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:33:31.264847 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:31.265808 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:31.273343 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:31.273916 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:31.274347 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:31.275036 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:31.275774 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:31.276198 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:31.430737 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:31.438728 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-880f022a-3b3d-4697-ba0f-040facc9fc3f tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1576 microversion: 2.1 time: 0.178103 Aug 31 19:33:31.439382 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 747/1449] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:31 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:32.463648 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:32.464521 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:32.471708 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:32.472182 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:32.472636 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:32.473325 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:32.473767 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:32.474178 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:32.608346 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.policy [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120707) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:32.616045 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-2e7ba625-d835-4d6a-9368-12e81e86fa3b tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1576 microversion: 2.1 time: 0.156676 Aug 31 19:33:32.616632 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 703/1450] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:32 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:33.638441 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:33.639761 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:33.646306 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:33.646777 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:33.647206 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:33.647896 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:33.648342 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:33.648799 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:33.855891 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:33.863673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-b8ccccb8-d8d0-4eea-95b0-bc2e5be16755 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1576 microversion: 2.1 time: 0.230006 Aug 31 19:33:33.864248 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 748/1451] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:33 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:34.059712 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [req-f85af97b-7b5a-4539-a787-5192d2d7042d req-062de457-308b-489c-a953-2ca447953330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e60f2b4-e476-4514-bd20-98e4405585f4", "name": "network-vif-deleted", "tag": "f9be4416-8330-4185-899b-dbd80c36cdd5"}]} {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:34.072176 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f85af97b-7b5a-4539-a787-5192d2d7042d req-062de457-308b-489c-a953-2ca447953330 service nova] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:34.072677 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f85af97b-7b5a-4539-a787-5192d2d7042d req-062de457-308b-489c-a953-2ca447953330 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:34.073108 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [req-f85af97b-7b5a-4539-a787-5192d2d7042d req-062de457-308b-489c-a953-2ca447953330 service nova] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:34.085266 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.compute.server_external_events [req-f85af97b-7b5a-4539-a787-5192d2d7042d req-062de457-308b-489c-a953-2ca447953330 service nova] Creating event network-vif-deleted:f9be4416-8330-4185-899b-dbd80c36cdd5 for instance 4e60f2b4-e476-4514-bd20-98e4405585f4 on hv-cinder-85221 Aug 31 19:33:34.091460 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [req-f85af97b-7b5a-4539-a787-5192d2d7042d req-062de457-308b-489c-a953-2ca447953330 service nova] 10.222.0.95 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035836 Aug 31 19:33:34.092552 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 704/1452] 10.222.0.95 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:34.886989 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:34.887723 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:34.895959 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:34.896455 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:34.897019 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:34.897767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:34.898303 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:34.898767 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:34.938598 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:34.939164 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:34.939600 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:34.940052 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.objects.instance [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lazy-loading 'fault' on Instance uuid 4e60f2b4-e476-4514-bd20-98e4405585f4 {{(pid=120706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:33:34.996753 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.policy [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1911f5d10c4fe38b6a6c4a0950726a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5bd468566364f12abbacb3928316c78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:35.007459 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-5f726959-8c7d-49aa-ba6a-9a3d48682146 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 200 len: 1184 microversion: 2.1 time: 0.124820 Aug 31 19:33:35.008030 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 749/1453] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:34 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 1184 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:36.029830 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:36.030606 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 4e60f2b4-e476-4514-bd20-98e4405585f4] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:36.037923 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:36.038400 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:36.038829 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:36.039514 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:36.039963 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:36.040381 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:36.053689 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] HTTP exception thrown: Instance 4e60f2b4-e476-4514-bd20-98e4405585f4 could not be found. Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Request method failure captured: Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 HTTP/1.1 Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7XBMs3YbvPTsRGS9I5F8zT1Ap9Mp_T2tw7-b-Yx9u3vomdGqb0x6L1NtcnRUq39OcueJjC2ysX6JDyYBSim6DwFTjz1visbvqqjz2Uvb3m0cQU6UeRP8pGdeVozljGiEM9sEEisYCCXq5Ny3ySrpPAFvFsuMC-YxEmy3hWnSYwGUpc Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:33:36.055412 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d5bd468566364f12abbacb3928316c78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: bc1911f5d10c4fe38b6a6c4a0950726a Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 4e60f2b4-e476-4514-bd20-98e4405585f4 could not be found. Aug 31 19:33:36.057070 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '4e60f2b4-e476-4514-bd20-98e4405585f4'} Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e60f2b4-e476-4514-bd20-98e4405585f4 could not be found. Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:33:36.058103 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e60f2b4-e476-4514-bd20-98e4405585f4 could not be found. Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e60f2b4-e476-4514-bd20-98e4405585f4 could not be found. Aug 31 19:33:36.059912 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.061422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Returning 404 to user: Instance 4e60f2b4-e476-4514-bd20-98e4405585f4 could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:33:36.061422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-5ce9a7cb-5db8-4662-aa8a-410a604043c0 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4" status: 404 len: 111 microversion: 2.1 time: 0.032182 Aug 31 19:33:36.061422 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 705/1454] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:36 2022] GET /compute/v2.1/servers/4e60f2b4-e476-4514-bd20-98e4405585f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:36.508707 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:36.509477 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.compute.api [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:36.517140 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:36.517623 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:36.518062 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:36.518758 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:36.519208 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:36.519635 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG oslo_concurrency.lockutils [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:36.534502 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.wsgi [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] HTTP exception thrown: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Request method failure captured: Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: request: DELETE /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df HTTP/1.1 Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept: application/json Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Accept-Encoding: identity Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Connection: close Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Length: 0 Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Content-Type: application/json Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Host: 10.222.0.95 Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: Openstack-System-Scope: None Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: User-Agent: python-urllib3/1.26.12 Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Auth-Token: gAAAAABjD7XBMs3YbvPTsRGS9I5F8zT1Ap9Mp_T2tw7-b-Yx9u3vomdGqb0x6L1NtcnRUq39OcueJjC2ysX6JDyYBSim6DwFTjz1visbvqqjz2Uvb3m0cQU6UeRP8pGdeVozljGiEM9sEEisYCCXq5Ny3ySrpPAFvFsuMC-YxEmy3hWnSYwGUpc Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Id: None Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Domain-Name: None Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Identity-Status: Confirmed Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Is-Admin-Project: True Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Id: default Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Domain-Name: Default Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Project-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Role: reader,member Aug 31 19:33:36.536165 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Roles: reader,member Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d5bd468566364f12abbacb3928316c78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-Tenant-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Id: default Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Domain-Name: Default Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Id: bc1911f5d10c4fe38b6a6c4a0950726a Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: X-User-Name: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: method: > Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: exception: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.537994 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: action_args: {'id': '535c47a4-fdfe-43c6-bb6e-76be6785b3df'} Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:33:36.539007 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.540673 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.542621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Returning 404 to user: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. {{(pid=120706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:33:36.542621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-9d165059-8164-45a1-9e55-52cea5dedd9a tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "DELETE /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 404 len: 111 microversion: 2.1 time: 0.032891 Aug 31 19:33:36.542621 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 750/1455] 10.222.0.95 () {58 vars in 1239 bytes} [Wed Aug 31 19:33:36 2022] DELETE /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:36.546837 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '>' {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:36.547446 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.compute.api [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] [instance: 535c47a4-fdfe-43c6-bb6e-76be6785b3df] Fetching instance by UUID {{(pid=120707) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:36.553560 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:36.554033 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:36.554467 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:36.555149 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Acquiring lock "95c90422-9fe5-49ea-9d04-23948be25350" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:36.555596 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:36.556134 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG oslo_concurrency.lockutils [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Lock "95c90422-9fe5-49ea-9d04-23948be25350" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:36.574395 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.wsgi [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] HTTP exception thrown: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Request method failure captured: Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: request: GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df HTTP/1.1 Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept: application/json Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Accept-Encoding: identity Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Connection: close Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Length: 0 Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Content-Type: application/json Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Host: 10.222.0.95 Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: Openstack-System-Scope: None Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: User-Agent: python-urllib3/1.26.12 Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Auth-Token: gAAAAABjD7XBMs3YbvPTsRGS9I5F8zT1Ap9Mp_T2tw7-b-Yx9u3vomdGqb0x6L1NtcnRUq39OcueJjC2ysX6JDyYBSim6DwFTjz1visbvqqjz2Uvb3m0cQU6UeRP8pGdeVozljGiEM9sEEisYCCXq5Ny3ySrpPAFvFsuMC-YxEmy3hWnSYwGUpc Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Id: None Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Domain-Name: None Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Identity-Status: Confirmed Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Is-Admin-Project: True Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Id: default Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Domain-Name: Default Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Project-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Role: reader,member Aug 31 19:33:36.576078 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Roles: reader,member Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2/d5bd468566364f12abbacb3928316c78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.95:8080", "publicURL": "http://10.222.0.95:8080/v1/AUTH_d5bd468566364f12abbacb3928316c78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95/volume/v3/d5bd468566364f12abbacb3928316c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.95:9696/networking"}]}] Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Id: d5bd468566364f12abbacb3928316c78 Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-Tenant-Name: tempest-TestVolumeBootPattern-659878814 Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Id: default Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Domain-Name: Default Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Id: bc1911f5d10c4fe38b6a6c4a0950726a Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: X-User-Name: tempest-TestVolumeBootPattern-659878814-project Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: method: > Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: exception: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.577862 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: action_args: {'id': '535c47a4-fdfe-43c6-bb6e-76be6785b3df'} Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: {{(pid=120707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:33:36.578838 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. Aug 31 19:33:36.580475 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: ERROR nova.api.openstack.wsgi Aug 31 19:33:36.582004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: DEBUG nova.api.openstack.wsgi [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Returning 404 to user: Instance 535c47a4-fdfe-43c6-bb6e-76be6785b3df could not be found. {{(pid=120707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:33:36.582004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: INFO nova.api.openstack.requestlog [None req-c09e4042-b9bd-407c-b478-0ba4b23701f5 tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df" status: 404 len: 111 microversion: 2.1 time: 0.035232 Aug 31 19:33:36.582004 dv-cinder-852210-6-iscsi devstack@n-api.service[120707]: [pid: 120707|app: 0|req: 706/1456] 10.222.0.95 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:36 2022] GET /compute/v2.1/servers/535c47a4-fdfe-43c6-bb6e-76be6785b3df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:37.882024 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: DEBUG nova.api.openstack.wsgi [None req-bd12e38d-3baa-40d6-8f98-647d289620ba tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] Calling method '.version_select at 0x7f975f578040>' {{(pid=120706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:37.906524 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: INFO nova.api.openstack.requestlog [None req-bd12e38d-3baa-40d6-8f98-647d289620ba tempest-TestVolumeBootPattern-659878814 tempest-TestVolumeBootPattern-659878814-project] 10.222.0.95 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-266363159" status: 202 len: 0 microversion: 2.1 time: 0.028062 Aug 31 19:33:37.907021 dv-cinder-852210-6-iscsi devstack@n-api.service[120706]: [pid: 120706|app: 0|req: 751/1457] 10.222.0.95 () {58 vars in 1260 bytes} [Wed Aug 31 19:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-266363159 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)